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Preface 


These are notes of a series of lectures I gave in 2012 at the Les Houches Summer School 
of Physics Strongly Interacting Quantum Systems Out of Equilibrium. The aim of these 
lectures was to provide an introduction to several important and interesting facets of 
out of equilibrium dynamics. In recent years, there has been a boost in the research on 
quantum systems out of equilibrium. If fifteen years ago hard condensed matter and 
classical statistical physics remained rather separate research fields, now the focus on 
several kinds of out of equilibrium dynamics is making them closer and closer. The 
aim of my lectures was to present to the students the richness of this topic, insisting 
on the common concepts and showing that there is much to gain in considering and 
learning out of equilibrium dynamics as a whole research field. These notes are by 
no means self-contained. Each chapter is a door open toward a vast research area. I 
endeavoured to present the most striking or useful or important concepts and tools, 
often just in an informal and introductory way. I hope this will stimulate the interest 
of the readers that will then have to get specialised reviews and books (cited in the 
notes) to fully satisfy their curiosity and get a complete knowledge. 
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Coupling to the Environment: What 
is a Reservoir? 


Depending on the problem one is facing and the fundamental questions one is ad¬ 
dressing a physical system can be considered closed or open, i.e. decoupled or not 
decoupled from the environment. Actually, no system is truly isolated; however, some 
can be considered so on a limited range of timescales over which the coupling to the 
environment does not take place. In the uprising field of non-equilibrium quantum dy¬ 
namics, which is the focus of this summer school, examples are provided by cold atoms 
and electrons in solids. In both cases there are situations in which the timescale over 
which dissipative effects take place is larger than the one corresponding to relaxation 
so that they can be considered isolated to some extent, see Altman’s and Perfetti’s 
lecture notes in this book. 

In statistical physics or condensed matter, one generically deals with open systems 
that exchange energy and particles with the environment, that henceforth we shall 
call reservoir (or bath). Just to cite a few examples, think to solvent molecules for 
colloidal particles or phonons for electron systems. Of course any open system can 
always be considered as a subpart of a closed one, so actually the real choice whether 
considering open or closed systems depends on the kind of questions one wants to 
address. 

In these lectures we will mainly focus on open systems except for discussing some 
fundamental issues related to thermalization. When studying open systems one de¬ 
clares all the rest of the world but the system ’’the environment” and changes the 
fundamental dynamical (Newton or Schrodinger) laws to take into account the role of 
’’the environment” on the system. This reductionist step from closed to open systems 
is a very subtle one. The aim of this chapter is to unravel the main physical ideas and 
technical steps that lie below it. 


1.1 What does a reservoir do to a system? 

Let us start our analysis with some informal considerations. We shall focus on classical 
physics just to keep the discussion as easy as possible. The dynamics of an isolated 
system is governed by Netwon’s law: 


d^x 


( 1 . 1 ) 
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where for simplicity we have written Netwon’s equation for a one dimensional particle 
of mass m, position x and subject to the external force F. There are two main effects 
due to environment: 


Dissipation. Throw a ball in the air and model your experiment with eq. (1.1). 


What do you get? The ball accelerates (you exert a force on it) and then, once 
you have thrown it, it should go straight with a constant velocity .... forever. 
What really happens is quite different even if you are a good baseball thrower! 
The ball inevitably falls down and stopsQ The initial kinetic energy given to the 
ball is dissipated in the environment. This effect is general and often is taken into 
account by adding a friction term to the equation of motion, which in the simplest 
case reads: 

(f'x dx ^ 

'Vr^=F ( 1 . 2 ) 


dF 


dt 


where rj is the strength of the dissipation. 

Thermal noise. There is something missing in the previous description. Statisti¬ 
cal mechanics teaches you that the equilibrium distribution of a system is given by 
the Boltzmann probability law. In particular, for a particle in an external poten¬ 
tial V, the Boltzmann law is P{x) = ^ exp(—t?(a:)/r) (henceforth the Boltzmann 
constant will be put equal to one). Consider for example the simplest case of a 


quadratic potential V{x) = ^x"^ for which F = —V'{x) = —x. Equation (1.2) 


implies that at long time the particle will sit in the bottom of the potential not 
moving at all, no matter what the initial condition is. The Boltzmann law instead 
predicts that the particle position fluctuates aroui id th e bottom of the well over a 
distance of the order y/T. What is missing in eq. (1.2) is a term corresponding to 


thermal noise: an environment at temperature T acts on the system with the net 
effect that energy is exchanged: sometimes the reservoir sucks energy out from the 
system and sometimes releases to it. Langevin proposed to take this effect into 
account by adding a random force to the previous equation, which in the simplest 
case reads: 

d^x dx ^ 

= F + ^(t) (1.3) 


dF 


dt 


where ^(t) is a Gaussian field with zero mean and variance {^{t)^{t')) = 2Tr]S{t — 
t'). This stochastic equation guarantees that the particle thermalizes at long times 
and that its probability distribution is given by the Boltzmann law for any initial 
condition. The proof is simple and will be shown in Chapter 3; as an exercise 


you can verify this result by explicitly solving eq. (1.3) in the quadratic case, 
V{x) = and averaging over the thermal noise. 

We have discussed the main effects of the environment in the case of a classical par¬ 
ticle in one dimension, an arguably very simple case. It turns out that more general 
cases may be more difficult technically—the dissipative term can be represented by 
retarded friction, the noise can be coloured and even multiplicative and non-Gaussian, 
and in the quantum case a formalism more involved than stochastic equations must 

^As a matter of fact, the longest ball throw was apparently done Gorbous, a Canadian minor 
leaguer, who in 1957 throw a baseball over 135.6m. 
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be used—still, the main physical effects, dissipation and thermal activation, are the 
same and play the same role. 

An important outcome of the previous analysis is that by taking into account these two 
effects and by changing the dynamical laws, the particle naturally thermalizes at long 
times at the temperature T of the environment. The fact that the environment is at 
equilibrium at temperature T is actually encoded in the relationship between fluctua¬ 
tion and dissipation. A generic non-equilibrated environment also leads to fluctuation 
and dissipation. However, only for an equilibrated one these are tightly related: the 
fact that the variance of the noise is 2Tri is an expression of this fundamental law that 
we shall discuss in more detail later. 


1.2 The simplest reservoir: linearly coupled Harmonic oscillators 

We now go over the ’’reductionist step” discussed before, showing how one can obtain 
an open system from a close one by integrating out the degrees of freedom that corre¬ 
spond to the reservoir. We do it for a simple, instructive and also quite general model: 
a system coupled to a very large set of Harmonic oscillators. In order to simplify a bit 
the notation we take the system one-dimensional. 

The total Hamiltonian reads: 


a — Hsyst + Hi + Hr 


(1.4) 


where 

is the Hamiltonian of the system we focus on, 


N 




is the Hamiltonian of the Harmonic oscillators and 

N 

Hi = — y] TkQk 

k 

is the interaction between the system and the oscillators. The number of oscillators is 
very large: N ^ 1. Moreover, the coupling jk is such that jk = Tk/VN, where jk is of 
the order of one, i.e. all oscillators interact with the system but very weakly. We will 
discuss the physics behind these two important assumptions later. For the moment, 
we just notice that these choices are the ones that come up naturally if one wants to 
study a system coupled to classical phonons. 
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Classical Phonons 

The phonons Hamiltonian is the one of Harmonic vibrations and reads: 

N/2 2 -^/2 


t)2 


{qi - ®+i)" 


i=-N/2+l 


e=-N/2 + l 


where i is the lattice site index that runs over N different values (we take peri¬ 
odic boundary conditions). The phonon-system interaction is local and without 
loss of generality we consider the case in which the system is located in the ori¬ 
gin. 

Hi = -qox 

We shall take a linear coupling, which is correct at small temperature (small 
fluctuations both of qi and x), but more complicated one can be considered 
too. It is easy to check that this model can be rewritten as the previous one: 
indeed, by going to Fourier space, i.e. defining Qk = Y^^I'^n/ 2 +i j all 

phonons are decoupled and are characterized by the frequency = 2(1—cos fc); 
each one of them interacts with the system via a coupling constant yj, = 1/ -s/N. 


The equations of motion for the system read: 

d?x 


m 


dH 

cPQk 

dt'^ 


= -V'{x) + ^y/cQfc 


= -uJkQk + ikx 


(1.5) 


( 1 . 6 ) 


A reservoir that is formed by Harmonic oscillators is simple to treat because it can 


be integrated out exactly; the generic solution of equation (1.6) can be readily found: 


tot 


Qk{t) = '^x{t) + [ (3fe(0) - ^x{Q) ) cos,{bJkt) + 


tot 


^^(O)Sm(a^ - f 

OJk Wfe Jo 


By plugging this expression into eq. (1.5) one obtains: 

rt 


m 


d‘‘x 

dt"^ 


+ [ cos(uJkit - s))x{s)ds =-V'{x) + "%x{t) 

Jo OJk t ^k 


2 

fe , 
,2 ■ 
k 


Dissipation 


Effective potential 




+ 7fe f Qfc(O) - ) cos(wfet) 


tOk 


(1.7) 


( 1 . 8 ) 


Nois 
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We have found that once the reservoir is integrated out new terms appear in the 
equation of motion for x: we have called them dissipation, effective potential and noise 
for reasons that will be clear in the following. Before discussing them, let us rewrite 
the previous equation in a more appealing form: 

K{t-s)x{s)ds = -V'{x)-V^jf{x)+^{t) (1.9) 

where K// = 5 Efe and 


K{r) = 5 : 

k 


7fc / X 
^ COS(WfcT) 


m =i: 


k ^ 


Qk{ohk"'^^^ + Tk[Qk{o) 


^x(O) I cosiujkt) 

^k J 


Now the meaning of each new term should become clear. The one corresponding to 
dissipation has indeed the form of a retarded friction. It is expected on general grounds 
since the system releases energy by interacting with the phonons. In our previous dis¬ 
cussion of the Langevin equation we didn’t add an effective force, —Vl^{x), due to 
the environment but this of course has to be expected too and is indeed what we 
find. The final term—the noise—is more problematic than the others. As its name 
makes clear, it should be characterized by some kind of randomness. However, as its 
definition makes also clear is perfectly deterministic. Where is the subtlety? We post¬ 
pone a complete discussion to the following section; for the moment we just notice 
that for typical values of Qk(^) and (5fe(0), i.e. values extracted from the equilibrium 
Boltzmann measure, the function ^(t) behaves so erratically that in practice is undis- 
tinguishable from a random function if N is moderately large (iV > 20); moreover ^(t) 
contains indeed some randomness since (5_ft:(0)’s and 0^(0)’s are random. 

In the following we assume that the reservoir, i.e. the phonons, are at equilibrium at 
time t = 0 given the position a;(0) of the system. In consequence their probability 
measure reads: 


P 


{Qfe(0),gfc(0)}|a:(0) 


= AAexp i-Yl 

\ k 


^Qkiof + ^Qkioy - ^lkQk{0)x{0) 


where Af is the normalization constant. By redefining the normalization constant the 
previous expression can be rewritten as: 


P 


{gfe(0),gfc(0)}|a;(0) = TV'exp 




2T 


Qk{Q) 



This simple rewriting reveals that (5fc(0) and gfc(O) — ^x(O) are independent Gaussian 

^ k 

variables of zero mean and variance T and T /ojf, respectively. It is now straightforward 
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to show that ^{t) is a Gaussian random function, since it is a sum of Gaussian variables; 
its mean and variance are given by: 


m = o mm) = TKit-t') 


This completes the ’’reductionist” step from the close to the open system. The main 
results we found are a first principle derivation of the Langevin equation and that 
dissipation and fluctuations (or noise) are related: the memory function appearing 
in the retarded friction term is exactly equal to the variance of the noise times the 



1.3 Noise and irreversibility 

Let us now discuss in more detail the noise term and to what extent it is random. In 
a real experiment the initial condition of the system an the environment is fixed, in 
particular <5^(0) and Qk{0) are fixed; in consequence, ^(t) is a completely deterministic 
function. Hence, one could wonder to what extent ^(t) does represent random noise. 
Well, it is known that deterministic function can be identical for any practical purposes 
to a random one. Think for example to the random number generators one uses in 
a Monte Carlo simulation: these are deterministic functions producing numbers that 
one considers random for all practical purposes. In reality these are not truly random 
because the sequence one obtains repeats after a certain number of trials. The better 
is the random number generator the longest is the period. The ’’noise” ^{t) behaves in 
a similar way; the larger is N the more it resembles to a random function. In the limit 
iV —>■ oo it is indeed indistinguishable from a random functiorj^ In order to better 
clarify this last statement, let us recall that there are two ways of doing averages: 

• Time Average. In this case, given an observable 0{x{t)), one computes its 


average as 



This is what one does in an experiment assuming that the system has reached a 
steady state. 

• Ensemble Average. In this case, given an observable 0(x(t)), one computes its 
average by averaging over all possible realizations belonging to the ensemble. In 
the case we are considering this means averaging over all possible initial conditions 
for the oscillators, i.e. over the values of Qfc(O) and (3^(0). This leads to an average 
over ^(t) which then indeed becomes a random function: 


/ 


{0)e = ^lim^ / '[[dQki0)dQk{0)O{x{T))P {(3fc(0),Qfc(0)}|a:(0) 


^The reader could be surprised since we got a factor of two less with respect to the Langevin 
equation introduced in the first section. There is no contradiction actually. The subtlety is that in the 
limit where K becomes a delta function, only half of the delta function contributes to the integrated 
friction. Thus, one has to take K{t) 2r;5(r) to get a friction term r)x. In this case one recovers that 
the variance of the noise is indeed 2T5{t) as expected. 

^The frequencies lo^ should be incommensurate in order for the mapping to a random function to 


hold. 
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The previous statement about the indistinguishability of ^(t) from a random function 
means that time averages and ensemble averages coincide. In particular 

mm)T = mm)E = TK{t-t') 


As stated previously, the parameter controlling how much the pseudo-noise ^{t) be¬ 
haves like a true noise is N, the number of degrees of freedom in the environment, see 


(Zwanzig 2001 Mazur and Montroll 19601 for more details. 


We arrived to the conclusion that for N large enough our deterministic open system is 
indistinguishable from a stochastic one based on the Langevin equation (1.91. It is easy 
to prove, as we shall show later on, that a system obeying such an equation thermalizes 
at long time, i.e. it goes to a steady state where the distribution is Maxwell-Boltzmann 
and all equilibrium relationships, like fluctuation-dissipation, are satished. 

Just to highlight how subtle is this reduction from a closed to an open system, let us dis¬ 
cuss an apparent paradox. Consider as a system a Harmonic oscillator, V{x) = 
and think to what the previous statement means: the oscillator thermalizes at long 
time for any initial condition. Isn’t it weird? The global closed system is just a col¬ 
lection of coupled Harmonic oscillators—the easiest integrable system one can think 
of! And, as you know, integrable systems do not thermalize. Where is the catch? The 
subtle point is that one does not have to resort to any chaotic dynamics to get irre¬ 
versibility and equilibration. There is nothing surprising once one realizes that the fact 
of having an environment with a very large number of degrees of freedom is the key 
ingredient: when = 4 one gets only quasi-periodic motion and no equilibration at 
all, but for A ^ 1 the quasi-periodicity is pushed up to times that are exponentially 
large in A, see (Zwanzig 2001). 

It is instructive to disentangle two processes that take place when a system reaches 
equilibrium: irreversible behavior and steady state properties given by Maxwell-Boltzmann 
distribution. The former is in general related to reaching a steady state and to damp¬ 
ing. An environment formed by a very large number of degrees of freedom leads to 
irreversible behavior and generically to a steady state but only one that is at equilib¬ 
rium leads to true thermalization (and this independently of its chaoticity, A ^ 1 is 
enough). See (Zwanzig 2001 Castiglione et al. 2008) for a general discussion on the 
relationship between irreversibility, thermodynamic limit and red herrings related to 
chaos. 


1.4 The environment 


By looking at the Langevin equation (1.9) one realizes that the only characteristic of 


the environment one needs to know is K(t). In order to describe K{t), it is useful to 
introduce the spectral function 


and rewrite K{t) = cos(wt). Environments are classified on the basis of the 

low frequency behavior of J(w) ~ rya;'’: an Ohmic bath corresponds to s = 1 whereas 
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a sub(super)-Ohmic one corresponds to s < l(s > 1) (Weiss 2008). Note that a purely 
Ohmic bath leads to K{t) = r]6{t). Of course, in reality, there is always a change of 
behavior at high frequency and, hence, the delta function acquires a finite width. 
Before concluding this chapter on the role of the environment let us stress that the 
previous procedure of integrating out the environment can be repeated in the quantum 
case as well. Indeed it is at the root of first principle descriptions of quantum open 
systems: examples are small quantum systems coupled to phonons, quantum dots 
coupled to non-interacting leads, etc... 

We postpone a complete discussion of quantum reservoirs to the following chapters. 
However, we anticipate that it is not possible in general to obtain a stochastic equation 
as one can do for classical systems. In the literature there are quantum versions of the 
Langevin equation (1.9) which are identical to the classical one except for the fact that 
the dissipation and fluctuations are related by the quantum fluctuation-dissipation 
relation. These are only approximations valid for small quantum fluctuations as we 
shall explain later on. For more discussion and details on open systems and the role of 


reservoirs, see the books (Zwanzig 2001 Castiglione et al. 2008 Weiss 2008, Gardiner 


and Zoller 2000). 












2 


Field Theory, Time-Reversal 
Symmetry and Fluctuation Theorems 


In the following we present a brief introduction and a derivation of the field theories 
used to study off-equilibrium dynamics in classical and quantum systems. We then go 
on studying a particularly important symmetry for equilibrium systems: time-reversal. 
Out of equilibrium systems violate this symmetry but, quite interestingly, this violation 
leads to a variety of interesting consequences that go under the name of fluctuation 
theorems and that received a lot of attention recently. We shall discuss them and 
conclude the section by addressing generalizations to the quantum case. 


2.1 Martin-Siggia-Rose-DeDominicis-Janssen field theory 

We consider an open classical system whose dynamics is governed by a stochastic 
equation. For the sake of concreteness and for simplicity we focus on a simplified 
version of the Langevin equation ( |1.9[ ): 

vHt) =-V'+ ^{t) =2Tr]6{t-t') (2.1) 


We neglected inertia and memory effects. This is reasonable in certain physical sys¬ 
tems such as e.g. colloids in which the system (colloidal particles) are much bigger 
and heavier (and hence much slower) than the particles forming the environment (sol¬ 
vent molecules). We present the derivation in this case, but also discuss the results 
we would have obtained in more general cases at the end. Note that we still focus 
on one dimensional systems just to keep the notation as less involved as possible (to 
this end we also set rj = 1, i.e. we reabsorb rj by redefining the unit of time). It is 
straightforward to generalize the results to higher dimensions. 

Studying the dynamics of a system means computing (or measuring) averages, corre¬ 
lation and response functions. Imagine we want to compute the average value of the 
observable 0{x{t)), where 0{x) is a generic function of x: 


{0{x(t))) = J D[^]dxoO{x^{t)) exp P{xo) (2.2) 

What the previous functional integration means in words is that one has to solve eq. 


(2.1) for a given ^(t) and initial condition xq, compute 0{x{t)) and then average the 
result over all possible Gaussian thermal noises and initial condition^ Formally, we 


^Note that the average in the previous equation is the ensemble average, cf. the previous chapter. 
Henceforth we shall neglect the subscript E to lighten the notation. 
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can insert in the previous integral a useful representation of the unity by integrating 
over all paths x[t] the functional Dirac 6 which imposes eq. (2.1): 

f D[x]6[x + V\x) - ?] = / D[x\D[x]e- ^ ^ 

J x(0)=xn 


lx(0)=xo 


Actually, a Jacobian should be also present but since it can be proved to be a constant 
we just absorb in the normalization of the functional integral This insertion is 
useful because it allows one to integrate out the noise—^just a functional Gaussian 
integral—and obtain the famous Martin-Siggia-Rose-DeDominicis-Janssen (MSRDJ) 
field theory: 

(0(x(t))} = J D[x]D[x]dxoO{x{t)) exp{S)P{xo) (2.3) 

where the action S reads: 


5 ” = - 



dt'x{t') [x{t') + V'ix{t')) - Txit')] 


(2.4) 


Using this field theory one can also compute correlation functions {0{x{ti))0{x{t2))) 
and response functions as discussed below. 


2.2 Meaning of the fields 

The MSRDJ field theory contains two fields: x[t] and The meaning of the former 
is clear: it represents the fluctuating degrees of freedom of the system. The latter is 


called response field, see (Cardy), because it intervenes in response functions. To see 
how this works let’s add an external field coupled to x{t): V{x) —>■ V{x) — hx. By 
repeating the previous derivation one finds that the action gets an extra term: 

S= - f dt'x{t') [i(t') + V'{x{t')) - Tx(t')] + f dt'x{t')h{t') (2.5) 

Jo Jo 


The response function measuring the variation of the average of x{t) due to an in¬ 
finitesimal and istantaneous external field acting at time d can be expressed in term 
of a correlation function of the fields x and x: 






{x(t)x{t')) 


Note that from this identity one can immediately obtain that the average of x is zero 
since the average of one does not change if one applies a field! Similarly, one can 
find that correlation functions with only x or in which the field with largest time is a 
response field vanish by causality. 


^This is actually a tricky business, see e.g. (Cardy 


Zinn-Justin 1996 


Kamenev 2011 In order to 


compute the Jacobian one has to specify the discretization of the Langevin equation. We choose the Ito 
discretization — = (—In this case it is easy to show that the Jacobian is indeed 

a constant. Other discretizations lead to different results. As long as the noise is not multiplicative, 
different discretizations lead to different field theories but physical averages are the same. In case of 
multiplicative noise instead different discretizations correspond to different physical processes. 


3 /^\ _ <^( 1 ) 

“ 5h(t') \ 


= 0 
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2.3 Generalizations 

We now report the resulting MSRDJ field theory one would have obtained starting 


from the full Langevin equation (1.9). The derivation, which is a straightforward gen¬ 


eralization of the previous one, is left as an exercise for the reader. One still ends up 
with a field theory on x, x; the difference is in the form of the actions which reads: 


poo 

S = — dt'x{t') [mx{t') + V'{x{t'))] — 
Jo 

pOO 


( 2 . 6 ) 


) nZ ^ pOO pZ 

dt / dt'x{t)rj{t — t')x{t') + - dt dt'x{t)v{t — t')x{t') 

Jo 2 Jq Jq 


where ri{t — t') = K{t — t') is the retarded friction and v{t — t') = TK{t — t') the 
variance of the noise. Because of the inertia one has now to specify both a:(0) and a;(0) 
as initial conditions. For more details see (Kamenev 20111 lAron et al. 20101 Kurchan 
2 ^ . 


2.4 Relationship with Schwinger-Keldysh field theory 

We now want to make a relationship between the MSRDJ held theory used to study 
the dynamics of classical open systems and the Schwinger-Keldysh one used for open 
quantum systems. As we have shown in the previous chapter the Langevin equation 
that we used as a starting point to derive MSRDJ is obtained starting from a sub¬ 
system coupled to an environment, the combination of the two being a closed system 


characterised by the Hamiltonian (1.4). The starting point to derive the Schwinger- 


Keldysh held theory is to write down a path integral representation for the dynamics 
of the sub-system coupled to the reservoir. Then, at the level of the functional integral, 
one can integrate out the reservoir degrees of freedom and obtain an action for the 
sub-system only. This is shown in the lectures by Aleiner and Berges so we shall not 


repeat it, see also (Kamenev 2011). We will only quote the main results. 


In the closed contour representation of the functional integral one has two helds x'^ (t) 
and x~ (t) corresponding to the two forward and backward time paths. In order to 
make the relationship with MSRDJ explicit, it is useful to make a change of variable 
and dehne: 


c(t) = 


x^{t)+x (t) 


i{t) = 


.x^{t) — x (t) 


2 " h 

In the literature these are also called classical and quantum field respectively. In terms 
of these fields the action of the Schwinger-Keldysh field theory can be written as: 


S = - {C\x — iTix/2] — C\x + ifix/2\) 


(2.7) 


poo pt ^ poo pt 

/ dt dt'x{t)r]{t — t')x{d)- / dt dt'x{t)iy{t — t')x{t') 

Jo Jo 2 Jq Jq 


/o ^0 ^ ^0 

where L is the Lagrangian of the sub-system: 

^ Wy -V{X) 
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and T]{t — t'), which is equal to K{t — t') as in MSRDJ, has the interpretation of a 
retarded friction; the other term, — plays the role of the variance of the thermal 


noise and is related to ry by the quantum fluctuation dissipation theorem (Weiss 20081. 
In Fourier space their relationship reads: 


^(lo) = hcoth 


huj 


9ry(a;) 


( 2 . 8 ) 


The properties of the environment are all encoded in the specific form of rj^uj). It is 
easy to check that MSRDJ field theory defined by the action (1.91 is the classical limit 

0 the quantum 
TK{t) so that 


of the Schwinger-Keldysh field theory. Indeed by taking the limit H 
fluctuation-dissipation relation becomes the classical one, i.e. v{t) - 


the second part of the action (2.71 coincides with the corresponding one of MSRDJ. 
Concerning the first part, by taking the limit h ^ 0 only the term linear in x survive 
and one indeed finds: 

i r°° 

lim - {C[x — ihx/2\ — C[x -\- ihx/2\) = — dt'x{t') [mx{t') -F V'(x(t'))] 
h^o h Jq 

Thus, the quantum nature of the Schwinger-Keldysh field theory is encoded in: (1) the 
relationship between ry and v, (2) the existence of terms with possibly all odd powers 
of X. In general one cannot interpret the action (2.7) as one originating from a physical 


stochastic equation. However, if one disregards all odd terms beyond the linear one 


then the corresponding field theory is MSRDJ-like for a Langevin equation (1.9) with 


a noise related to the friction via the quantum dissipation relation. This stochastic 
equation is the so-called quantum Langevin equation. It corresponds to the first term 
in the expansion in the quantum field hx and, hence, is valid only in the regime of 


small quantum fluctuations. See (Weiss 2008) for more material on quantum Langevin 
equations. 


2.5 Time-reversal symmetry 

Time-reversal is the symmetry that characterizes an equilibrium system: being at 
thermodynamic equilibrium means being unable to determine the arrow of time. 

In the following we shall show how this symmetry arise within the MSRDJ formalism. 
Consider a trajectory x[t] starting from xg at time t = 0 and reaching Xf at time 
T. The time-reversed trajectory of x[t\ is defined as XR{t) = x(t — t). Although the 
response held is not a physically measurable held, it is useful to also dehne its time- 
reversed counterpart: Xfl(t) = x{t — t) -\- ^■ Let us study now how the action 
transforms under time-reversal. First, we shall rewrite it as: 

S{x[t],x[t]) = - [ dt'x{t') [x{t') + V'{x{t')) - Tx{t')] = (2.9) 

Jo 

- dt'x[t')V'{x[t')) + T ^x(<') - -f 

The second and third term are clearly invariant under time reversal whereas the hrst 
time leads to an extra constribution: 









Time-reversal symmetry 13 


S[xR[t],XR[t]] = S[x[t],x[t]] + ^ [ x{t')V'{x{t'))dt' 

^ Jo 

The probability to measure the time-reversed trajectory for the system, given the 
initial condition Xf at time 0 reads: 

P{xR[t]\xR{0) = Xf) = j D[xR]exp{S[xR[t],XR[t]]) 

By applying the time-reversal transformation which amounts just to a functional 
change of variables (whose Jacobian is one) one finds: 

P{xR[t]\xR{0) = Xf) = J iJ[i] exp -b ^ J x{t')V'{x{t'j)dt'^ 

By separating the two terms in the exponential, performing the integration over time 
for the second and formally integrating over x, we find 


PixR[t]\xR{0) = Xf) = P{x[t]\x{0) = Xo)e ° (2.10) 


„ V (x) 

By dividing both terms by the partition function Z = j dxe^i^ , bringing e 

the RHS and recalling that the equilibrium probability measure is Peq{x) = e 
we finally find the expression of time-reversal symmetry 


T 

-v(^) 

T 


on 

/Z 


P{xR[t]\xR{0) = Xf)Peq{xf) = P(a;[t] |a;(0) = Xo)Peq{xo) 

which simply means that the probability of starting from xq in equilibrium and follow¬ 
ing a given path to Xf coincides with the probability of starting from Xf in equilibrium 
and following the time-reversed path. This is a general property of equilibrium dynam¬ 
ics. We showed it for Langevin dynamics, i.e. a classical system coupled to a bath, but 
it is generically valid for all physical equilibrium dynamics, in particular Netwon and 
Schrodinger evolutions. 

A general principle in physics is that the existence of symmetries implies non-trivial 
identities for correlation functions and observables: the most famous example being 
momentum and angular momentum conservations laws and invariance with respect 
to translations and rotations. We thus expect that time-reversal symmetry leads to 
important consequences. Indeed three fundamental relationships that are generically 
taken as fundamental signature of equilibrium dynamics can be derived from it: time- 
reversal symmetry of correlation functions, fluctuation-dissipation relations and On- 
sager reciprocity relations. 
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Consequences of time reversal symmetry 

• Time-reversal symmetry of correlation functions: (Oi(ti) • • • 0„(t„)) = 
{Oi{—ti)---On{—tn)) where Oi{ti)s are observables at time ti. This is 
a direct implication of the fact that it is not possible to identify micro¬ 
scopically an arrow of time: the direct and time-reversed path have the 
same probability. 

• Fluctuation dissipation relations: R{t—t') = ^dt>C{t—T) where C{t—t') = 
{x{t)x{t')) and R is the response of {x{t)) to a field applied at time t'. 

• Onsager reciprocity relations: RAB{t—t') = RBA{t—t') where Rab denotes 
the response of {A{t)) when a field conjugated to the observable B is 
applied at time t'. 


These three identities can be easily proven following the procedure outlined above and 
performing the change of path in the functional integral. They are identities between 
correlation functions implied by the time-reversal symmetry (formally the response 
function is a correlation function between the physical and the response fields). Their 
proof is left as an exercise to the reader. Note that one also needs to use that the 
system is in a steady state, i.e. it is time-translation invariant, which means that in¬ 
deed it is at equilibrium (the only steady state possible for a finite system coupled 
to an equilibrium reservoir is equilibrium dynamics, as we shall discuss in the next 
chapters). 


2.6 Time-reversal symmetry breaking and fluctuation relations out 
of equilibrium 

In the last fifteen years it has been realised that studying the way in which time-reversal 
symmetry is broken out of equilibrium leads to new kind of fluctuation relations. These 
are valid out of equilibrium and belong to what is now called the field of stochastic 


thermodynamics, see e.g. (Seifert 2008). This topic deserves a series of lectures on its 


own, which is certainly out of the scope of these notes. On the other hand, one cannot 
certainly avoid to mention it. With this in mind in the following I shall just discuss one 
of the most known relations, discuss its physical origin in a nutshell and then point 
out complete reviews for the interested readers. As the identities discussed before at 
equilibrium, these out of equilibrium relations hold for all types of physical dynamics. 
Our analysis will be performed using Langevin dynamics. 

As setting for out of equilibrium dynamics we choose: 


x{t) = F{t) + m mat')) = 2T6it - t') 


where F{t) is a generic time dependent force that we write as F{t) = —V'{x{t), X{t)) -j- 
f(t). This representation means that the system is out of equilibrium for two reasons: 
a control parameter of the external potential is changed during the dynamics and 
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moreover there is a non-conservative force applied to the systerrj^ This is a very simple 
model but it contains the essence of the problem (treatments for more complicated 
models are straightforward generalizations). Repeating the derivation that lead to eq. 
(2.101 one now finds: 


P{xR[t]\xR{0) = Xf) = P{x[t]\x{0) = xo)e 


-Indt^ 


( 2 . 11 ) 


The term JJ" dtxF has the interpretation of the heat exchanged between the system 
and the bath ( [Seifert 2008 ). To see where this interpretation comes from, remember the 
first law of thermodynamics (applied in a small interval of time dt): dw = dV + dq, the 
work done on the system is equal to the change in energy plus the heat exchanged. The 
work done on the system reads from the mechanic point of view: dw = ^\dt fdx. 
Using the chain rule dV = ^\dt -|- ^dx we can eliminate dw from the two previous 
equations and obtain dq = {—^ + f)dx = Fdx. 

From the relationship above all fluctuation relations valid out of equilibrium can be 
derived straighforwardly. In the following we show how this works in a specific case 
and derive the Jarzinsky-Crooks identities. 

Consider the specific out of equilibrium protocol where the system is at equilibrium 
at t = 0 and is brought out of equilibrium by the changing of the external parameter 


X{t). We take / = 0, i.e. F = —V'{x{t), X{t)). The term in the exponential of eq. (2.11) 
can be rewritten in this specihc case as: 




dtxF = 


dt 


dV au A _ U(x/,A(t))-U(xo,A(0)) w 
dt dX ^ T T 


where W = ^Xdt is the work performed on the system between time 0 and r. Note 
that IF is a stochastic quantity since it is a functional of the dynamical trajectory. 


Multiplying eq. (2.11) by the Boltzmann measure that the system would have reached 
if it was equilibrated at r, i.e. and multiplying the RHS by ZijZi 

we finally get the equation: 


P{xR[t]\xR{0) = Xf)Peq{Xf) = P{x[t]\x{0) = Xo)PeqiXo)e 


-T “I" 


( 2 . 12 ) 


where AU = — \og{Zf jZi) jjd is the difference in the free energies corresponding to the 
two equilibrium states characterized by value of A equal to A(t) and A(0). 

Let’s now integrate eq. ( 2.12| ) over all paths. This leads to the celebrated Jarzynski 
identity, see (Jarzynski 1997): 

(e T ) = e T (2.13) 


which is remarkable since it express the average over an out of equilibrium process 
(LHS) in terms of a pure equilibrium quantity (RHS). This is at first sight a surprising 
result and even lead to debates at the beginning, since on the LHS there is an average 


"^The force is non-conservative because it depends explicitly on time and, moreover, it is generi- 
cally assumed to not derive from a potential (for this latter statement one needs to consider spatial 
dimensions higher than one since in one dimension a generic function of x can always be written as 
the derivative of a potential). 
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over a completely out of equilibrium process whereas on the RHS we only find the 
equilibrium free energies for A = A(t) and A = A(0). Using Jensen’s inequality one 
derives that (TU) > AF which is an expression of the well known Clausius inequality of 
classical thermodynamics: the dissipated part of the work, {W) — AF, has to be positive 
or equal to zero. This is one example of a main result of stochastic thermodynamics: 
a microscopic statistical mechanics identity, eq. (2.13), from which macroscopic ones 
characteristic of classical thermodynamic can be derived. 


Another interesting relation can be obtained by integrating (2.12) over all paths that 


correspond to a given value of the work W. This leads to the Crooks identity (Crooks 


1998): 


Pr{-W) = P{W)e 


W I I 
rp “T 


where P{W) is the probability to observe the work W during the non-equilibrium pro¬ 
cess and Pr its time-reversed counterpart. It is interesting to consider a cyclic process, 
which means that A(0) = A(r). In this case, the previous identity is a constraint on 
the form of P{W)\ 

P{-W) = P{W)e-^ 


If the process is adiabatic {W) = AF = 0, i.e. no work is done on the system globally. 
On the other hand a typical out of equilibrium process leads to dissipation and to 
an average value {W) = Wdiss > 0. The previous equation implies that even though 
P{W) is centred around Wdiss > 0 it necessarily has tails extending to negative val¬ 
ues: the probability of measuring a negative work in a cycle-an apparent violation of 
thermodynamics-is finite and given by dWP(W)e~^. 

This example contains the essence of stochastic thermodynamics and its main conse¬ 
quences. First, it allows to understand, actually derive, the laws of thermodynamics as 
identities on averages. Second, it also shows that since for large systems the quantities 
like W, AF, are extensive, i.e. they scale as the number of degrees of freedom, the ex¬ 
ponential weights in these out of equilibrium identities are extremely small. Thus for 
large systems the probability of observing violations of the laws of thermodynamics 
is extremely small. It vanishes in the thermodynamic limit as expected, which is a 
very nice way to show the emergence of thermodynamics as a theory of macroscopic 
systems. The previous observation also implies that these fluctuation identities are in 
practice meaningful only for small systems, i.e. in situations where the terms in the 
exponential are not too negative and hence probability of "violations” of thermody¬ 
namic laws are not too rare events. There are several experimental systems where this 
is the case and these laws have been tested and/or usefully applied, e.g. colloidal parti¬ 
cles, proteins, etc. We refer to the review by Seifert (Seifert 2008) for a comprehensive 
introductions to this field. 


2.7 Quantum systems 

Time-reversal symmetry and its implications discussed in the two previous sections 
also hold for quantum systems, even though derivations are sometimes more involved. 
In the case of equilibrium quantum dynamics time-reversal symmetry implies, as in the 
classical case time-reversal symmetry of correlation functions, fluctuation-dissipation 
relations and Onsager reciprocity relations. The only difference being the form of the 
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fluctuation-dissipation relation. 

In the case of quantum out of equilibrium dynamics, identities analogous to the ones 
obtained for classical system can be derived. Sometimes issues related to process mea¬ 
surements in quantum mechanics arise. This makes the quantum version a bit more 
subtle. 

We discuss, as an example, the Jarzynski-Crooks equalities for which the issue of 
providing a correct definition of work arise. The easiest derivation is obtained for an 
isolated system, so we focus on this case to keep things as simple as possible. In the 
classical case, since the system is closed and does not exchange heat, the work is simply 
the difference between the final and the initial energy. In the quantum case, one has 
to take into account the measurement process in order to recover Jarzynski-Crooks 


equalities, see (Kurchan 2008 Esposito et al. 2009). The correct measurement protocol 


was defined in this way: one starts at t = 0 from the Boltmann density matrix, mea¬ 
sures the energy Ei, does the non-equilibrium process and measures the energy again, 
Ef, at the end. The measurements lead to a collapse of the wave function, hence at 
the beginning of the process the system is in an eigenstate of the initial Hamiltonian 
H{X{0)) and at the end in an an eigenstate of the final Hamiltonian H{X{t)). With 
this in mind it is easy to write down the probability distribution of the work: 


piw) = 


o-Er./T 

z. 


- E„)) 


where T denotes time-ordering. The probability for the reversed process reads: 

o-Em/T _ , 2 


PniW) = Y. 




6{W - [E^ - E^)) 


where T denotes reverse time-ordering. By renaming the indices n, m in m,n in the 
last equation and by noticing that the amplitude squared term is the same between 
the two expression one recovers the Crooks identity that we derived previously in the 
classical case. 

As discussed for classical systems, fluctuation relations out of equilibrium are useful for 
small systems. In the context of quantum systems the recent interest in nano-devices 


provides a natural ground to study and develop these new relations, see (Esposito et 


al. 2009) for a comprehensive review on the subject. 
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Thermalization 


In this chapter we shall discuss in some detail the issue of thermalization, which is the 
process by which a system initially out of equilibrium relaxes to the thermal Maxwell- 
Boltzmann distribution, the cornerstone of equilibrium statistical mechanics. We shall 
discuss first systems coupled to a bath and then focus on the more difficult problem of 
isolated systems. Understanding how and why physical systems thermalize is a funda¬ 
mental problem which is at the root of statistical physics. Note that not all systems do 
it, actually several physical systems are found to be out of equilibrium. Some of them 
are driven out of equilibrium by shear, currents, dissipation, etc. hence they cannot 
equilibrate; others instead just fail to equilibrate at least on experimental time-scales. 
Before discussing these latter cases in the following chapter, we now explain why equi¬ 
librating is more the rule than the exception, which is also the reason why avoiding 
equilibration is so interesting and puzzling. 

3.1 The meaning of thermalization 

A macroscopic system, classical or quantum, is said to have reached thermalization 
if all the time-averaged local observables and correlation functions coincide with the 
ones obtained by the ensemble average over the Maxwell-Boltzmann distribution: 

lim - [ 0{t)dt = {0 )t 

T^OC T Jq 

where O denotes a local observable, which means an observable whose value depends 
on degrees of freedom that are locally close in real space: for example a products 
of spin operators contained in a finite subsystem or products of local densities in a 
liquic0 The average on the RHS is the usual ensemble average of statistical mechan¬ 
ics: it is performed using the Maxwell-Boltzmann distribution at temperature T. The 
value of T is fixed by the dynamical evolution: for an open system it is given by the 
temperature of the bath, for an isolated system it is the value of the micro-canonical 
temperature leading to an average intensive energy equal to the one of the system 
(which is conserved during the dynamics since the system is isolatedjj^ The reason for 
insisting that observables have to be local will be discussed at the end of this chapter. 
It is important for macroscopic systems only. 

^In the quantum case 0{t) is the expectation value under Schrodinger evolution. 

^We assume that there are no conserved quantities other than the energy. If this is not the case 
one has to add more control parameter conjugated to the extra-conserved variables, e.g. the pressure 
for the volume, etc. 
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What makes thermalization mind-boggling at first sight is that the LHS of the pre¬ 
vious equality depends on a lot of things, in particular on the initial condition and 
on the bath evolution if the system is open. On the RHS instead the only parameter 
that matters is the temperature of the bath or the initial energy if the systems is 
isolated: all the extra knowledge (or information) contained on the LHS has to be lost 
irreversibly during the dynamical evolution. This is the reason that makes equilibrium 
statistical mechanics so powerful. We don’t need to know almost anything on the past 
history of the system to predict its equilibrium properties. 

As anticipated before, thermalization is expected to be the rule for macroscopic sys¬ 
tems. However, proving that a system does thermalize can be a tough problem es¬ 
pecially for isolated systems. In the following we shall first discuss the case of open 
classical systems. 


3.2 Classical systems coupled to a bath 

Showing thermalization for classical systems coupled to a bath is the most easy case, 
and for this reason we shall discuss it in detail in the following. As we have shown 
in the first chapter, the deterministic dynamics of a classical system coupled to a 
bath reduces to a stochastic damped dynamics for the system alone. Within this 
framework time-averages coincide with averages over the stochastic noise. Thus proving 
thermalization means showing that at long times averages over the stochastic noise 
converge to Maxwell-Boltzmann averages: 


lim (0(t)} = {0 )t 


We shall consider finite systems, so there is no difference between local and non-local 
observables. For simplicity, we focus again on a one-dimensional system undergoing 
over-damped Langevin dynamics: 

^ = -v'{x) + m , mm) = ^TSit - f) (3.1) 


where the friction 77 has been reabsorbed in a re-definition of the unit of time and V (x) 
is an external potential. Although this is the simplest setting one can choose, it is very 
instructive and not so reductive after all, since all other cases can be treated tech¬ 
nically as simple generalisations. Indeed, introducing inertia, considering non-white 
noise and systems with more than one degrees of freedom lead to more complicated 
stochastic equations which can always be re-written as sets of coupled Langevin equa¬ 
tions introducing extra-variables. For example in the case of inertia one introduces the 
momentum p = x and write the second-order stochastic equation as a two first-order 
coupled Langevin equations of the type described above. 

In the classical case, an observable is a function of the configuration of the system; 
in the simple case we are considering just a function of x. Introducing P(x,t), the 
probability distribution of x at time t, thermalization can be expressed as: 


lim 


/ 


r „-V{x)IT 

= /^— 


dxP{x, t)0{x) 


0{x) yO{x) 
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since this has to hold for any function 0{x), it implies that: 

lim 

t—¥oo 


where Z is the partition function. 

The way to proceed to show that this is indeed what happens consists 
an equation for the evolution of P{x,t). This is quite standard and can 
several textbooks, see e.g. (Kamenev 2011 Kurchan 20081. The starting 
identity: 

= j voM 


in deriving 
be found in 
point is the 


The LHS can be re-written in a discretised way as 


1 

dt 


,dO . , 1 d^O ,. , . 2\ 


In order to go further and understand why the second term has been retained one 
has to specify the discrete form of the Langevin equation. We choose the so-called 
Ito-prescriptiorj^ which corresponds to the discretization 

:,[t + dt)-x{t\ ^ ^ mm) = (3.2) 

where St^t' is the Kronecker delta. Now that everything is well defined we can evaluate 
the terms obtained above. 


^dO 
'' dx 


x) = {'^[-V'{x)+m) = {^(.-y'{x))) = - [ Pix,t)'^V'{x)dx 

dx dx J dx 


In the first equality we have used the expression of the Langevin equation and in the 
second one that x{t) is uncorrelated from the noise at the same time t, see eq. (3.2). 
As for the second term: 


1 d^O 


{xdtY) 


1 d^O 
2^~d^ 


(-y'(x) + c(t))^) 


only the term containing the square of the thermal noise is of the order dt. It is equal 
to 

where we have used again the same tricks than before. Collecting all the pieces together 
and dividing by dt we hnally reach the equation: 


dtP{x, t)0{x)dx = 


0(x}— (V(x)P(x, t)) dx 
dx 


0{x)T 


d?P{x, t) 
dx'^ 


dx 


^Another one would lead to the same results but to a different derivation. Strictly speaking the 
stochastic equation we wrote is ill-defined in the continuum limit and the only correct mathematical 
way is to define it through its integrated version. 
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Since this has to be true for any function 0(x) the distribution P(x,t) satisfies the 
so-called Fokker-Planck equation: 

dtP(x, t) = ^ (v'{x) + P{x, t) (3.3) 

By staring at this equation two observations immediately comes to mind. First, it 
is clear that the Maxwell-Boltzmann distribution is stationary since the RHS vanishes 
for P{x,t) = Second, it looks much like an imaginary time Schrodinger 

equation: 

dtP{x,t) = —HppP{x,t ), Hpp = —— -f 

The analogy is however not as straightforward as it seems at first sight since thermal 
averages cannot be written as quantum averages. In fact, introducing the bra-ket 
notation, formally solving the Fokker-Planck equation and denoting by (1| the bra 
corresponding to the function equal to one for all x, i.e. (l|a:) = 1, we get: 

{0{x{t))) = {l\Oe-^^^*\Po) = 

where we have explicitly used that {l\Hpp = 0 and |Po) represents the initial prob¬ 
ability distribution. For a fixed initial condition xq, one has (a:|Tb) = ~ ^o)- The 

expression above differs from its quantum mechanic counterpart for three main rea¬ 
sons: (1) the time is imaginary, (2) Plpp is not a Hermitian operator, (3) the bra (1| 
is not the transposed of the ket |Po)- Nevertheless the analogy is useful as we discuss 
below. Before let us list some general properties of Hpp. Their derivation is easy and 
left as an exercise to the reader. 


Properties of Hpp 

• Hpp is not Hermitian but the operator Hs = Hppe~'^/'^'^ is Hermi¬ 

tian as it can be checked by simple algebra. 

• Hs is a positive operator, i.e. all its eigenvalues \i > 0. 

• The eigenvalues of Hpp coincide with the ones of Hs and, hence, are all 
positive. 

• Under very general hypothesis, i.e. if the potential V(x) grows fast enough 
when \x\ —)■ oo, all Ai are positive but one. The single eigenvalue Ai = 0 has 
the Boltzmann distribution as right eigenvector and (1| as left eigenvector. 


These properties imply that the Maxwell-Boltzmann distribution is the only sta¬ 
tionary distribution. Moreover, by decomposing the initial distribution |Po) and us¬ 
ing right and left eigenvectors of Hpp (which form a basis of the Hilbert space): 
l-fo) = EiCilOfl where c, = i(i|Fb), we find: 
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P{x,t) = ^e ^'*c^{x\i)R 


In consequence, since all exponentials but one vanish at long times and ci = 1 by 
normalisation, we have proven the convergence to the Maxwell Boltzmann distribution 
for any initial condition: 

P{x,t) -^ 

Along the way, we have also found that the the eigenvalues of Hpp have the interpre¬ 
tation of inverse relaxation times. The time to reach equilibrium is given by I/A 2 . 
Several other interesting properties come out from this analogy with quantum me¬ 
chanics both for classical and quantum systems. From the classical point of view, 
using spectral analysis of Hpp and WKB methods it is possible to show that the right 
and left eigenvectors allows one to define very precisely and quantitatively metastable 


states and their basins of attraction, see (Gaveau and Schulman 1998 Biroli and Kur- 


chan 2001 Bovier et al. 2000). From the quantum point of view, the analogy was 


fruitful to construct variational wave-functions a la Jastrow (Mahan 2000) and also 


in the analysis of quantum spin liquids. In this context, quantum dimer models were 
shown to display special points in their phase diagram, the so-called Rokshar-Kivelson 
point, at which the quantum Hamiltonian maps exactly on a Fokker-Planck operator 


Hpp (Rokhsar and Kivelson 1988). Thus allowing one to obtain several results on the 


ground state properties from the knowledge of the corresponding classic stochastic 


dynamics (Henley 2004). 


3.3 Quantum systems coupled to a bath 

Showing thermalization is more difficult for open quantum systems, however gen¬ 
eral results have been obtained recently. One has to show in full generality that the 
Schwinger-Keldysh field theory for a quantum system coupled to a bath leads to ther¬ 
malization at long times. Although this has been done in the classical limit for the 


MSRDJ field theory (Gozzi 1984), up to now it has b een only performed on sp ecihc, 
albeit quite general, settings in the quantum cas^ ( [Poyon and Andrei 2006 ). The 
arguments that have been used are too involved to be presented here and we refer to 


the original publications (Gozzi 1984 Doyon and Andrei 2006). 


Despite these technical difficulties, from the physical point of view, there is no reason 
to doubt that a finite quantum system coupled to a bath do not thermalize. Actually, 
equilibration is even more likely for a quantum system than for a classical one because 
of quantum fluctuations. An instructive case is provided by the double well potential 
in Fig. [XT] which models a situation in which there is a metastable state that can trap 
the dynamics for some time. A classical system starting at t = 0 in the left well with 
small kinetic energy needs to receive energy from the bath in order to jump across 
the barrier and reach equilibrium. This is a less and less likely process the smaller 
is the temperature and leads to a life-time of the metastable state that follows the 


^If one approximates the dynamics of a qua ntum open system using Lindblad operators then 
proving thermalization is rather straightforward ||Gardiner and Zoller 2000[|. 
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Fig. 3.1 Double well potential 


Arrhenius law where AE is the height of the energy barrier that the system 

has to overcome, see e.g. (Kurchan 20081 for a derivation of this result. Strictly at zero 
temperature a classical system starting in the left well looses kinetic energy, absorbed 
by the bath through friction, and remains trapped forever in that well, never reaching 
the right well which corresponds to the true ground state of the system at T = 0. 
Instead in the quantum case, because of quantum tunnelling the system would never 
be trapped and eventually relax to equilibrium at T = 0. 

Only if the two wells have exactly the same height then the quantum system could 
avoid thermalization. Depending on the strength of the coupling to the bath and the 
spectral properties of the bath, localisation in one well can occur at T = 0. This is the 
famous Caldeira-Leggett problem (Leggett et al. 1987). 


3.4 Isolated systems 

The theory of thermalization of isolated system is one of the most venerable part of sta¬ 
tistical mechanics. For classical systems is by now a textbook subject (good textbooks 
only though), instead for quantum systems it is a topic on which current research is 
still focusing on. My aim in the following is certainly not giving a presentation of it, 
which is well beyond the scope of these notes. It would deserve a series of lecture on 
its own. I would like instead to discuss some important points and to describe briefly 
the results on quantum systems. 
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3.4.1 Classical systems 


In the case of classical systems, the theory of thermalization is intertwined with the 
one of ergodic systems. The bottom line is that a system whose dynamics is chaotic 
enough (mixing) thermalises. Roughly (very roughly), these two properties mean that 
if one starts with a distribution of initial conditions strongly peaked around a certain 
point Xq of configuration space, after a certain (equilibration) time the distribution 
obtained by following the dynamical trajectories will be almost uniformly spread on 
the hyper-surface corresponding to all points with an energy equal to -E(xq). 

We shall not spend more time on ergodic theory and refer for the interested reader to 


modern textbooks such as (Castiglione et al. 2008). We would like just to mention two 


important points: first proving that a system is ergodic is extremely difficult and it has 
been achieved in academic cases only. On the other hand it is thought that generically 
a macroscopic interacting system is ergodic. This actually is routinely observed in 
molecular dynamics simulations of interacting particle systems that thermalize quickly. 
Integrable systems are an exception to this whole scenario. They are not ergodic and. 


by KAM theory (Castiglione et al. 2008), perturbations of such systems are not ergodic 


if the perturbation is small enough. On the other hand it is currently believed and 
sometimes shown that the KAM region corresponding to the values of the perturbation 
where the system remains non-ergodic shrinks to zero in the thermodynamic limit, see 


for example the studies of the Fermi-Pasta-Ulam model (Casetti 1997). In summary 


all macroscopic interacting systems should thermalize except an ensemble of very fine- 
tuned ones, say of measure zero in the space of models, which correspond to integrable 
systems. If a macroscopic system is found numerically or experimentally to avoid 
thermalization this has to do with an underlying phase transition and the emergence 
of very long time-scales but certainly not with a loss of chaoticity. 

One point that is often not stressed enough is that there is more to thermalization 
than just ergodic theory. The other very important aspect is considering macroscopic 
systems and focusing on special observables, in particular local observables because 
these are naturally what we look for in simulations and experiments. Why is this 
important? Let us do an analogy with Monte-Carlo dynamics. Imagine to have IV Ising 
spins that flip with a rate A = I/tq and to start the dynamics from the configuration 
with all spins up. This Monte-Carlo dynamics is the one characteristic of T = oo since 
spins flip independently of the initial and final configuration. Hence, the Monte-Carlo 
dynamics is just a random walk in the configuration space (which is an hyper-cube 
in N dimensions). It is easy to show (exercise!) that it thermalises toward the flat 
distribution which, as expected, corresponds to the Maxwell-Boltzmann distribution 
for T = oo {e~^^ = 1). Spins flip independently with a rate I/tq, hence the time- 
average of local correlation functions or observable converge to their thermalised values 
within a time-scale Tq, which is therefore the relaxation time. On the other hand on the 
time-scale tq, all spins have flipped a finite number of time in a given run, so the system 
has visited a number of configuration which is of the order of N only, much much 
smaller than the 2^ configurations available. How is possible then that the system 
seems thermalised as if the measure was flat in configuration space and at the same 
time the number of configurations visited is extremely small? The way out, sketched 
pictorially in Fig. |3.2[ is that typical dynamical trajectories visit the configuration 
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Fig. 3.2 Sketch of the progressively blurring of the probability measure over time. Usual 
physical observables are unable to probe the granularity of the measure, whereas unphysical 
ones such as the characteristic function corresponding to the being in one given many-body 
configuration do. 

space in such a way that for the observables we usually focus on time-averages are 
essentially identical to the ones obtained by the Maxwell-Boltzmann measure: the 
random walk very quickly spreads over the configuration space. Observables local 
in real space cannot probe the granularity of this spreading and, as far as they are 
concerned, the distribution obtained after a time-scale tq is identical to the flat one 
even though this is clearly not the case. For instance, imagine that one focus on 
the observable equal to one if and only if the configuration is the one with all spins 
down. This is clearly not a local observable, actually it corresponds to a point 
correlation function. Its thermalised value is 1/2'^. In order to reach thermalization 
for this observable one has to wait a time long enough to be sure that this configuration 
is encountered at least once during the dynamics. An estimate of this time, more a 
lower bound actually, is given by tq times the number of configurations available 
divided by the number of configuration visited in a time tq. The resulting time scale is 
tq2^/N ^ Tq which is much larger than the relaxation time tq and actually enormous 
for realistic values of N. This example is very instructive since it contains the essence of 
the issue we wanted to clarify. Although we pointed it out for Monte-Carlo dynamics, 
the same ideas hold for for isolated systems. Also in this case it is crucial to take into 
account that we always focus on (I) macroscopic systems and (2) observables which 
are local. Non-local observables can avoid thermalization or display it on a time-scale 
which is gigantic and anyhow completely irrelevant for all practical purposes. 

3.4.2 Quantum systems 

The problems mentioned above for classical systems are even more striking for quan¬ 
tum ones. In particular, it is clear that it does not make much sense to talk generically 
about thermalization of finite isolated quantum systems. In fact, many such systems 
display a discrete spectrum and, starting for a given initial condition, they show Rabi- 
like oscillation and do not even reach a steady state. 

Let us then focus from the beginning on macroscopic systems. The initial condition 
for the dynamics is a given wave-function lip). Thermalization means that 
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where we have used on the RHS the micro-canonical average at intensive energy e, 
which equals the average energy of the initial condition /N. Decomposing lijj) 

on the eigenvectors |a) oi H we find: 


1 _ pi{Ep-Ea)T/h 

lim 4ca{f3\0\a)— - -h ^ |caP(a|0|Q) = {0)e 

l{Ea,-E0)T/h 


Under very general hypothesis, see (Barthel and U. Schollwock 2008), the first term 


on the LHS, dies off in the large r limit. Hence the formal expression of thermalization 
reads: 

Y \ca\'^ {a\0\a) = ^Y («e|0|ae) 

OC OCe 

where are the eigenstates with intensive energy e and Af = is the micro- 
canonical normalisation factor. Again, as at the beginning of this chapter, we face the 
riddle of thermalization: the LHS contains a lot of information on the initial condi¬ 
tion since the Ca = (q:|V') depend on the initial wave-function the RHS instead 
depends on e only. How is possible that by changing the initial condition but keeping 
the average intensive energy fixed all the c^s change but in such a way that the sum 
above does not? Clearly this is generically impossible for a finite system. As stressed 
before, considering very large systems is mandatory. Only in the thermodynamic limit, 
the distribution of the Cq,s can reach a limit in which this becomes true. 

The solution of this riddle was started to be elucidated by Deutsch and Srednicky 


(Deutsch 1991 Srednicki 1994) with the introduction of the so-called Eigenstate Ther¬ 
malization Hypothesis (ETH). The main idea is that a given eigenstate is thermal, i.e. 
the average of any local observable in an eigenstate must coincide with the one obtained 
by equilibrium thermal average: if (Q:|0|a) depends on a only through its intensive 
energy then it is clearly equal to the micro-canonical average which is given by the 
flat sum over all eigenstates characterized by the same intensive energy. Again, this 
cannot be true in a finite system and can become true only as a limiting process for 
N —)■ oo. Indeed, it is easy to show, see (Biroli et al. 2008), that the distribution of 


the values of {a\0\a) for a given local observable becomes peaked around the micro- 
canonical value in the thermodynamic limit. These however is not enough to have an 
argument for thermalization since even though the majority of eigenstates lead to the 
micro-canonical average if there exist rare ones for which this does not happen then 
thermalization could be avoided in principle if the initial conditions have a projection 
large enough on them. 

Two solutions to this impasse were discussed in the literature. The first, that we called 


strong version of ETH (Rigol et al. 2008) is sketched in Fig. 3.3 not only the distribu¬ 


tion of {a\0\a) becomes peaked but also its support shrinks to zero so that effectively 
in the thermodynamic limit all states verifies ETH. The second is that the support 
does not shrink to zero but physical initial conditions are spread in configuration space 
in such a way that rare states never give a contribution, i.e. the |cqP are rather uniform 


(see the discussion in (Biroli et al. 2008) for more details). What is the correct solution 


is not clear yet, since the values of N available in numerical diagonalization are not 
large enough to solve this issue clearly, neither rigorous proofs are available. What is 
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Fig. 3.3 Cartoon of how the distribution of {a\0\a) evolves by increasing N. In the strong 
version of ETH the support shrinks to zero so that indeed in the thermodynamic limit all 
states verifies ETH. 


becoming clear, however, is that for integrable systems, that indeed do not thermalize, 
the distribution of {a\0\a) has a finite support in the thermodynamic limit and the 
failure of thermalization is due to sampling of rare states. 

In summary, macroscopic isolated quantum systems generically are expected to ther¬ 
malize similarly to classical systems,. There is however an important exception which 
is due to the presence of quenched disorder: quantum disordered systems can show 
Many Body Localization, i.e. localisation in configuration space and avoid thermaliza¬ 


tion (Basko et al. 2006 Nandkishore and Huse 20141. This is a pure quantum effect 


with no classical counterpart. Contrary to classical systems, in the quantum world 
there could be a new kind of breaking of ergodicity which is not due to any underlying 
thermodynamic phase transition. 










4 

Quenches and Coarsening 


There are two ways of putting a system off equilibrium: by an external drive (e.g. 
a shear, a voltage difference, etc...) or by changing a control parameter C (e.g. the 
magnetic field, the temperature, the pressure, etc...). In the former case the system 
is maintained out of equilibrium, whereas in the latter it starts to evolve towards the 
new equilibrium state corresponding to the new value of C. This may take a long time. 
Sometimes, so long, that the system remains out of equilibrium forever. In this chapter 
we focus on this latter kind of slow relaxation and out of equilibrium dynamics. We 
shall consider systems coupled to a bath since this is the common situation and discuss 
at the end the case of isolated systems. 

As we discussed in the previous chapter, the relaxation time of a an ensemble of inter¬ 
acting classical or quantum degrees of freedom coupled to a bath is generically finit^ 
Thus, one expects that after the change of the control parameter C a finite system 
reaches equilibrium in a finite time. Only in the thermodynamic limit one can ob¬ 
serve never-ending off-equilibrium relaxation, which is therefore, as phase transitions, 
a collective phenomenon with at least one growing correlation length. A simple argu¬ 
ment to see why this must be the case is that if all correlation lengths were bounded 
during the relaxation, then one could roughly divide the system in independent finite 
sub-systems each one having a finite relaxation time ts- In consequence, the system 
would have to relax on timescales not larger than ts which contradicts the starting 
hypothesis of never reaching equilibrium on any hnite timescales. 

4.1 Thermal Quenches 

Let’s consider a system that displays a second order phase transition at a temperature 
Tc- We consider the following protocol which is called thermal quench: the system 
starts at equilibrium at a temperature Ti at time t = 0, see. Fig. |4.1[ The temperature 
of the heat bath is then suddenly changed at a value Tj. Theoretically, we shall study 
the limiting case where this happens instantaneously. In reality the rate is finite, 
and actually often quite large, e.g. a fraction of Kelvin per minute, see Fig. |4.2[ In 
the literature the time spent after the quench is called waiting time and denoted 
tw In our case this coincides with t since the quench occurs at time t = 0. Our 
argumentation is general but for concreteness it is useful to have in mind an example, 
e.g. the ferromagnetic Ising model undergoing some kind of Monte-Carlo dynamics. 
The Hamiltonian of the Ising model reads: 


possible exception is provided by zero temperature baths, see Chapter 3. 
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(D 



0 Tf Tc Tf Ti 


Fig. 4.1 The two different protocols discussed in the main text. In the first the quench is 
toward a temperature Tf > Tc whereas in the second is across the phase transition. 

H = —J ^ CTiCTj (Ti = ±1 yi = 1,..., N 
(iJ) 


where the sum is over nearest neighbours on the three-dimensional cubic lattice. This 
model has a phase transition between a high temperature paramagnetic phase and a 
low temperature ferromagnetic phase characterized by long-range ferromagnetic order 
and a non-zero intensive magnetisation m. 

We consider first the protocol in which the final temperature, Tf, is larger than Tc- In 
this case the system equilibrates after a characteristic time-scale, r, that depends on 
Tf (and possibly other control parameters and microscopic quantities). 


T{t) 

Ti 


0 


Tf 


t 


Fig. 4.2 Temperature time-dependence during a quench. The dashed line corresponds to 
realistic situations whereas the continuous line to the sudden quench studied theoretically. 

This means that one-time quantities like the magnetization, the energy, etc. ap¬ 
proach for t 3> T their equilibrium values and, hence, they become time independent, 
whereas for example the two-time correlations and response functions become invari¬ 
ant under translation of time, i.e. they depend just on the time difference. Very often 
this approach to equilibrium is exponential in time. See Figs. [T^ and [T^ 
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E{t 



t 


Fig. 4.3 Sketch of the time-evolution of the energy after a quench with protocol (1). The 
relaxation to the equilibrium value is fast and often exponential in time. 


C{t + tw,tw) 



Fig. 4.4 Sketch of the time-evolution of the two-time correlation after a quench with protocol 
(1). Consider for instance the case of the spin-spin correlation function in the Ising model: 
Cir + 

tw ■) tw ) “ ^ + . Once becomes of the order of the relaxation time 

the different curves converge and the two-time correlation function becomes time-translation 
invariant. 


Finally, typical equilibrium relations like fluctuation-dissipation relations between 
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correlation and response are verified. 

In the second case, where Tf < Tc, one-time quantities still approach their equilibrium 
values at long times but slowly, with a power-law time dependence, see Fig. 4.5 A 


first signal that the dynamics changes crossing the phase transition. A more strik¬ 
ing behaviour is found in two-times correlation functions, which display a first rapid 
relaxation to a plateau value over a time-scale t, that depends on Tf, and then a 
second relaxation from the plateau to zero which takes place on an increasingly larger 


time-scale, see Fig. 4.6 



Fig. 4.5 Sketch of the time-evolution of the energy after a quench with protocol (2). The 
relaxation to the equilibrium value is slow and often power law in time. 
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C{t +tyj,t.w) 



Fig. 4.6 Sketch of the time-evolution of the two-time correlation after a quench with protocol 
(2). Consider for instance the case of the spin-spin correlation function in the Ising model: 
C(t -\- twytw) = The different curves never converge. The time to 

escape from the plateau becomes larger the larger is the time spent after the quench. 

Two things are striking in this behaviour: (1) the first relaxation toward the plateau 
is the one characteristic of systems equilibrated at Tf, i.e. it coincided with what one 
would observe starting the dynamics from equilibrium at T = Tf. For example, in 
the case of the Ising model, the spin-spin correlation function converges to a plateau 
value equal to (2) no matter how long is the time spent after the quench the 
system does not equilibrate. Correlation functions do eventually escape from their 
plateau value and never become time-translation invariant. The time-scale on which 
these non-equilibrium effects take place is not an intrinsic time-scale hxed by Tj (or 
other parameters) but instead depends on the age of the system itself: it is larger the 
larger is the time spent after the quench. For this reason this behaviour is called aging 
and emerges generally in quenches across phase transitions. 


4.2 Coarsening 

To understand what’s going on and what is the physical origin of the out of equilibrium 
dynamics, the most useful thing is to look to the results of a numerical simulation, 
a picture actually. We shall focus on our preferred example: the aging (Monte-Carlo) 
dynamics of the three dimensional ferromagnetic Ising model after a quench from the 
high disordered temperature phase to a temperature at which, in equilibrium, the 
system is ordered. In Fig. |4.7| two snapshots of a 2D cut of the 3D Ising model after a 
quench from the high to the low temperature phase are shown (black color is used for 
minus spins and white for plus spins). 
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Fig. 4.7 Two snapshots of a 2d cut of a 3d ferromagnetic Ising model evolving with a Glauber 
dynamics after a quench at time t — 0 from high temperature to T < Tc. Black color is used 
for minus spins and white for plus spins. On the left the configuration reached after = 10^ 
MonteCarlo steps. On the right the configuration reached after = 10® MonteCarlo steps. 
Statistically the two configurations looks the same after a length rescaling. 

What do we see? Four main features. 

• The system wants to break the symmetry and does it locally over a length-scale 
^{t) which grows with time. 

• The figure looks self-similar, i.e. after rescaling the unit of length using ^{t) right 
and left panel would look the same. 

• The system reaches local equilibrium over domains of size ^(t). 

• The locally equilibrated domains do not persist forever: negative magnetised re¬ 
gions become positively magnetised on larger times (and so on and so forth). 

These features are generically found in quenches across second-order phase transitions. 
The results of numerical simulations, experiments and theoretical analyses lead to the 
emergence of a description of the resulting out of equilibrium dynamics which is called 
coarsening and it is based on the following well verified assumptions: the system breaks 
the symmetry locally and forms domains inside which a temporary local equilibrium 
is reached. Inside each domain one of the possible low-temperature values of the order 
parameter is displayed, in the case of the Ising model these correspond to ±to. The 
characteristic size of the domains, ^(t), grow with time generically in a power law way. 
The out-of equilibrium dynamics is characterized by scaling with respect to ^(t). For 
instance, two-time correlation functions can be expressed in terms of scaling functions 
and power laws: 

(04r + t)O.W) = j^/(!^.|h) (4.1) 

where Ox is a generic observable evaluated at site x, e.g. Ox for the Ising model. This 
scaling description only holds on large time and large length-scales. On hnite times 
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and finite lengths, less than ^{t), correlation functions display their equilibrium form. 
This description is confirmed by all results obtained so far and is considered to hold 
generically. What changes from one case to another, depending on the type of second- 
order phase transition that is crossed by quenching, is the growth law of ^(t) and the 
specific form of the scaling functions. These need a case by case study. In the following 
we shall explain in detail the analysis of the Ising model, or more generically quenches 
across phase transitions in which the order parameter acquires two different values. 
Before doing that, we conclude this section pointing out that only in the thermo¬ 
dynamic limit the out of equilibrium dynamics goes on forever. For a finite system, 
instead, when ^ (t) reaches the size of the system there remain few domains and, after 
a while, only one survives. Which values of the order parameter it corresponds to, e.g. 
plus or minus m for the Ising model, it is a random event that depends on the previous 
(stochastic) dynamics. After the timescale r^, defined by ~ L where L is the 

linear system size, another behaviour sets in: the system remain for a very long time, 
much larger than tl, in one of the ordered states until a very rare random fluctuation 
creates a system spanning domain corresponding to another ordered state that then 
take over. In the case of the Ising model this process corresponds to the creation of an 
interface between the plus and minus states and it takes place on a time-scale scaling 
as r ~ exp (ATL^/T/) where AT is a constant. 


4.3 Curvature-driven Domain Growth 

As explained above, the out of equilibrium dynamics emerging after a quench across 
a phase transition is due to the evolution of the domains structure. In order to un¬ 
derstand the main physical reason for this evolution we shall focus on quenches across 
phase transitions in which the order parameter acquires two different values and on 
the simplest case of a single spherical domain. 

We model the dynamics using a Langevin Equation for the ordering field (the mag¬ 
netisation for ferromagnets): 



The potential E((/)(x)) has a double well structure with two minima at </)+ and </>_ of 
equal heights. The thermal noise corresponds to a heat bath at temperature T, that we 
take equal to zero at first. One can of course wonder how much the results we will find 
depend on the large amount of assumptions and approximations already done. The 
answer is that as for critical phenomena, the physics on large time and length-scales, 
is independent of these assumptions which just determine a few constants but not the 
scaling laws and the scaling functions. 

The initial condition for the dynamics correspond to a spherical domain of radius R 
corresponding to ())(r) = for r R, 4>(r) = cj)- for r ^ R and a sharp drop from 
(/)+ to at r ~ R, see Fig. 4.8 




Curvature-driven Domain Growth 35 




Fig. 4.8 Sketch of the spherical domain whose evolution is analysed in the main text. 
Because of spherical symmetry the zero temperature Langevin equation reads: 

d'^ fh( V f \ d 1 

dt^{r,t) = V20(r,t) - y'(</.(r,t)) = + —ct>{r,t) - V'{ct>{T,t)) 

As we have discussed, the dynamics of large domains takes place on long time scales. 
In consequence, for ii 3> 1 we search for a scaling solution of the previous equation. It 
is natural, and as we shall show correct, to focus on a travelling wave form: (/)(r, t) = 
f(r — R(t)). Since 4>{r, t) is expected to maintain the shape corresponding to a domain, 
the function f{x) equals 4>+ for a: <C 0, (/)_ for a; ^ 0 and has a drop between these 
two values at a: = 0. By plugging this Ansatz in the evolution equation we obtain: 

/"(r - R{t)) + 0 + R{t)^ fir - R{t)) - V\f{r - i?(t))) = 0 

Since f'{r — R{t)) vanishes for |r —i?(t)| 1 one can replace by up 

to sub-leading corrections of the order 1/R(t). The only way for the previous equation 
to be consistent is that the middle term, which violates the travelling wave form, 
cancels out. This leads to two equations 

R{t) = -2/R{t) (4.2) 

fix) - V'ifix)) = 0 (4.3) 

The solution of the first reads R(t) = y/R^(0) — At. The second is equivalent to the 
Netwon equation for a particle moving in the inverted potential —V (/) starting at time 
—oo at (j)+ and arriving at infinite time at cj)- (in this analogy / and x respectively 
denote the particle position and the time). Energy conservation imposes f'{x)'^ 
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V{(j>+) = V{f) at all times. From this equation one obtain the solution in terms of the 
implicit equation 

/■/(^) 

Jo y/V{f) - F(</)+j 

The final result is that a large spherical domain shrinks and is characterized by an 
interface whose shape is given by f{x). The equation R{t) = —2/R{t) is a special form 
of a more general equation valid for non-spherical domains ( Bray 2002[ ) which express 
the fact the local speed of the interface of a domain is proportional to its curvature. 
In consequence wavy domains tend to flatten out and small compact domain tend to 
shrink. In particular a spherical domain of size R shrinks and disappears in a time 
t rx R?. This relationship between time and length, that follows from the equation on 
is very general and implies that small domains disappear faster than large ones. 
The net result is that after a time-scale t domains of size less than have disap¬ 
peared typically. What remai ns are mainly dom ains of size y/t with a typical radius of 
curvature of the order of Vt (Sicilia et al. 2007). 

This is a way to justify the scaling assumption: indeed we just obtained that after a 
time the characteristic length-scale ^{t) is of the order y/t. To fully derive the scaling 
eq. (4.1) one needs to show also self-similarity, but this is beyond the scope of these 


notes. For a thorough discussion and an exact derivation of the scaling laws see (Sicilia 


et al. 2007). 


Let’s now lift the the simplifying assumption of considering quenches to zero temper¬ 
ature. Qualitatively the results remain the same for any Tf < Tc- Inside the domains 
there is a local equilibration at temperature Tf and although there are now stochastic 
thermal fluctuations the evolution of domains is in average still driven by the curvature. 
The only main change is in the pre-factor of the growth law which is renormalised by 
thermal fluctuations. One finds that the typical length-scale ^{t) grows as ~ D{Tf)^/i 
where DiTf) vanishes when Tf ^ Tc as a, power law (see next section for a derivation 
of this result). The scaling functions are expected to remain unchanged. 

Combining all previous results we can now explain the behaviours sketched in Figs |4.5| 
and |4.6| The energy approaches as a power law its equilibrium behaviour because the 
only contribution comes from the boundary of the domains since the regions inside the 
domains are equilibrated. Hence they do not give any extra contribution compared to 
the equilibrium case, whereas instead the boundaries of the domains cost extra-energy. 
This extra surface energy is of the order of the surface of the domains There¬ 

fore the extra-energy per unit of volume scale as 1/^(0 oc 1/ Vi, which leads to a power 
law approach to the asymptotic value for the energy as a function of time. Concerning 
the behaviour of correlation functions, Fig |4.6[ the first rapid decrease to the plateau 
is related to the equilibration inside the domains (toward the value m(Tf)'^), whereas 
the secondary evolution is due to the slow motion of the domains and described by 
the scaling theory. 

A natural question is how general is this description of the out of equilibrium dy¬ 
namics after a thermal quench across a phase transition. The answer is very general. 
The main underlying mechanism is always the same: the system breaks the symmetry 
locally over a length-scale ^(t). Below this length the system is equilibrated in one of 
the possible symmetry-breaking state, whereas the slow out of equilibrium dynamics 
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is due to the motion of the topological defects that break the symmetry. These are 
domain walls for the 1? symmetry we considered previously, but they can be more 
complicated objects, e.g. vortices for the X — Y model in two dimensions. In order 
to obtain a description of the out of equilibrium dynamics one has to understand the 
evolution of the defects. This depends on the kind of symmetry breaking and the na¬ 
ture of the resulting topological defects: it is curvature-driven for domain walls as we 
explained whereas instead is (to a good approximation) diffusion for vortices. This 
actually leads again a growth law ^(t) oc Y'i which has however a very different phys¬ 
ical origin. In general the growth law is power law for quenches across second-order 
phase transitions, ^(t) oc and the value of the exponent depends on the dynam¬ 
ics and the kind of symmetry breaking. As in critical phenomena z depends on the 
dynamical conservation law, for example quenches across the ferromagnetic transition 
or equivalently spinodal decomposition is characterized by 2 = 2 if the dynamics does 
not conserve the order parameter, as we have derived before, and by z = 3 in the 
conserved case (Bray 2002). Contrary to critical phenomena z is in general dimension 
independent and, hence, there is no upper critical dimension. 

A final comment concerns quenches exactly at T^, also called critical quenches. These 
are characterized by growth laws which are different from the previous ones and are 


related to the critical behaviour characterising the equilibrium phase transition (Cal¬ 


abrese and Gambassi 20051. In particular, the typical lenth-scale over which the sys¬ 
tem is out of equilibrium, grows as where Zd is the exponent relating time 
and length-scale in equilibrium critical dynamics ( Calabrese and Gambassi 2005| ) (z^ 
and z are generically different, e.g. for the 2D Ising model Zd — 2.17 and z = 2 for 
non-conserved dynamics). There are no well defined domains in this case; instead the 
system should be considered a patch-work of equilibrated critically correlated regions 
of length ^(t). There are still scaling functions but different from the ones obtained 
for Tf < Tf,. In summary critical quenches and thermal quenches below both lead 
to out of equilibrium dynamics, which are however quite different. 


4.4 Kibble-Zurek Mecbanism and Slow Thermal Quenches 

In the previous secton we studied very sudden quenches. Here we focus instead on very 
slow ones. This is interesting for several reasons. First, real quenches are generically 
slow: temperature can be decreased at rates of a fraction of Kelvin per minute, i.e. on 
time-scales which are very large compared to the typical microscopic ones (picoseconds 
or less). Moreover, theoretically, studying slow quenches is useful to understand the 
connection between critical and standard coarsening. 

Consider a situation in which the order parameter inducing the quench, for instance 
the temperature, is changed slowly over the time-scale tq\ 

T{t) = T, + {Tf-T{)^-±^ 

We consider a quench across a phase transition, i.e. Ti > Tc and Tf < Tc- Clearly, if 
tq is much larger than the characteristic microscopic time scales then, at least at the 
beginning of the evolution, the system follows adiabatically the temperature change. 
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Since by decreasing T the phase transition is approached, the system develops long- 
range equilibrium correlations over a length-scale ^{T{t)) oc \T{t)) — Tc\~''. 



Fig. 4.9 Sketch of the phase diagram for slow quenches. Until T* the evolution is adiabatic 
and the system develops critical long-range correlations. 

Because of this ’’stiffness” due to the spatial correlation the characteristic time- 
scale over which the equilibrium dynamics takes place also increases as T(T{t)) oc 
oc \T{t)) — where v and Zd are the equilibrium critical exponents, see Fig. 

|4.9| This divergence implies that the adiabatic evolution inevitably breaks down when 
T{t) approaches Tc too closely. In order to estimate when this happens we consider a 
system that reaches the temperature T{t) in equilibrium, i.e. following adiabatically the 
temperature change, and compare the interval of time At that remains before crossing 
Tc- If this is smaller than the equilibrium relaxation time T{T{t)) then the system has 
to fall out of equilibrium. In this way we obtain an equation for the temperature T* 
at which adiabatic evolution breaks down: 

At = cs r(T*) ^ (T* - T,) (x 

J/ 

As expected, the smallest is the cooling rate, i.e. the largest is tq, the closest the sys¬ 
tem can approach Tc remaining in equilibrium. Nevertheless, for any large but finite 
value of Tq, the adiabatic evolution eventually breaks down. Our main aim is to find 
the growth of the characteristic length-scale R{t) over which the system is ordered as 
a function of time. 

Physically, there are three regimes: first the system follows adiabatically the tempera¬ 
ture change and develops critical correlations. When it goes out of equilibrium at T*, 
it is a collection of critically correlated regions that start to grow by critical coarsen¬ 
ing. There exist domains in this regime, but they are fractal and characterized by a 
magnetisation which is not extensive. Eventually, a cross-over from critical to standard 
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coarsening takes place: domains become compact, the magnetisation inside becomes 
extensive and the evolution starts to be dominated by the curvature of the bound¬ 
ary of the domains. In the following we assume scaling and use that R{t) tracks the 
equilibrium correlation length during the adiabatic regime and at very long times we 
have to recover the coarsening growth law R{t) oc . Since the characteristic time- 
scale governing the cross-over from adiabatic to off-equilibrium evolution is T(T(t)) 
the scaling law reads: 


R(t) = mm (^) 


where the two regimes, adiabatic and standard coarsening, respectively corresponds 
to the —oo and -l-oo limit of the scaling variable x = r{T{t)) ■ order to recover the 
expected growth law in these regimes f{x) has to go to one for x m —oo and to 
diverge as x^^^ for x m -l-oo. The latter result allows us to obtain the pre-factor of 
the coarsening growth law: one finds R(t) oc (T(t) — hence, 

D(T) oc {Tf — if the temperature is kept constant at Tf at long times. 

Kibble and Zurek originally studied this problem in cosmology, largely independently 
from coarsening in statistical physics. They were mainly interested in the density of 
topological defects created out of equilibrium when the temperature T(t) is below T^. 
and symmetric respect to T* (the end of the so-called impulse regime). In the time 
interval between the adiabatic regime and the time at which T{t) becomes equal to 
Tc — {T* — Tc) the length R{t) grows following the critical coarsening law. As it can be 
explicitly checked, this increase just leads to a value that is greater than the one at the 
end of the adiabatic regime by a numerical factor greater than one. In consequence the 
density of topological defects N is proportional to R{t*)~‘^ oc ■ Because of the 
original works by Kibble and Zurek, this result and some of the arguments explained 
above go under the name of Kibble-Zurek mechanism for the formation of topological 
defects, see the reviews! Zurek 19961. The explanations presented above are based on 
(Biroli et al. 2010). The Kibble-Zurek mechanism has been recently the focus on an 
intense research activity in the context of quantum quenches for isolated quantum 
systems. On this point, see E. Altman’s lectures in this book. 


4.5 Quantum fluctuations 

Let us now take into account quantum fluctuations. A generic phase diagram for 
a quantum system undergoing a second order phase transition is the one shown in 
Fig. 4.10 in which T represents the strength of quantum fluctuations ( jSachdev 2011 1. 
At zero temperature a quantum critical point (QCP) takes place at T^ from which 
originates the critical line separating the disordered and the ordered phases. This 
line ends for T = 0 at the classical value of the critical temperature. Consider now 
quenches where the control parameters, T or T, are changed in order to cross the 
transition line, see Fig. 4.10 (quenching T is experimentally feasible by changing the 
bath temperature, changing T is a more theoretically oriented protocol). 
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Fig. 4.10 Typical form of a phase diagram for a quantum system displaying a second-order 
phase transition. The dashed line indicates several different quenching protocols. 


The resulting out of equilibrium dynamics is very similar to the one described in the 
classical case: the system equilibrates locally over a length-scale of size ^{t) that grows 
with time as a power law. In particular, for a quantum ferromagnets or generically 
for systems with only two competing low temperature states, one finds again domain 
growth. Correlation functions display a behaviour similar to the one discussed before. 
Equilibration seems to takes place on short-time scales toward a plateau value which 
is related to the value of the order parameter at Tf,Tf. However, ageing behaviour, 
which is related to the motion of topological defects that break the long-range order 
on the scale ^(t), eventually sets in. As it is clear from Fig. |4.11 although quantum 
fluctuations show up in the first part of the relaxation (for instance the correlation 
function displays oscillating behaviour due to quantum coherence) they seem to be 
absent in the out of equilibrium regime. This is indeed the case since this regime takes 
place at very long time. Hence, dissipation and decoherence inevitably kick in and 
quantum coherence is lost. In consequence the motion of the topological defects is 
classical and, accordingly, the out of equilibrium is governed by classical coarsening 
laws. Whether exceptions to this conclusion can be found is not clear. In particular 
quenches across QCP, i.e. by changing T and keeping the bath temperature at T = 0, 
are still not well studied. Since in this case, depending on the bath density of states, 
the coherence effects can be much long-ranged in time there could be room for a more 
important influence of quantum fluctuations on out of equilibrium ageing dynamics. 
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Fig. 4.11 Typical form of a correlation function after a quench in quantum systems (result 
from [Biroli and Parcollet 2002] ). The inset shows the evolution for times r <C t™: the system 
displays equilibrium dynamics. In the main panel, for r oc ageing behaviour is manifest. 


Recently, there has been an intense research activities on quantum quenches, i.e. 
protocols in which an isolate quantum system initially in the ground state is put of out 
equilibrium by changing suddenly a coupling in the Hamiltonian. The discussion of 
the resulting dynamics is out of the scope of these lectures and, moreover, is an issue 
still not completely settled. By quenching the coupling one effectively injects energy 
inside the system since for the new Hamiltonian the old ground state is a wave-function 
consisting in a mixture of excited states. Hence, we expect is that the rapid degrees 
of freedom equilibrate and provide a bath for the slow degrees of freedom that then 
undergo classical coarsening at long times. This is indeed what happens for classical 
systems in analogous situations (Kockelkoren and Chate 20021. An unexpected be¬ 
haviour could result from the non-thermal fixed point discussed in Berges’ lectures. 
Indeed it was found that depending on the type of initial condition isolated quantum 
systems could approach a quasi stationary critical behaviour reminiscent of turbulence. 
The competition between this behaviour and coarsening is presently not understood. 
Another effect found in the literature are the so-called dynamical transitions, see e.g. 

(Sciolla and Biroli 20131 and refs therein. These could be actually related to the non- 
thermal fixed point just discussed above. As the reader has certainly understood from 
these few lines: the research on quantum quenches is still very much ongoing. Surprises 
and new explanations are to be expected. 
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Quenched Disorder and Slow 
Dynamics 


The presence of quenched disorder can induce very slow dynamics and lead to new 
kind of out of equilibrium phenomena. In this chapter we present some of them. First 
we discuss the effect of disorder on equilibrium dynamics and then focus on out of 
equilibrium ones. This chapter is just an introduction, a comprehensive presentation 
would deserve an entire series of lectures on its own, see for instance the Les Houches 
lecture notes (Cugliandolo 20021. Some topics will be left out for lack of space, in 
particular glasses and spin-glasses that would need quite a long discussion. 


5.1 Broad distribution of relaxation times 

One of the most relevant phenomenological consequences of quenched disorder is the 
presence of several relaxation times: the heterogeneity induced by the disorder leads 
to the simultaneous presence of regions that relax fast and other that relax slow. 
Instead of having a characteristic time-scale t, disordered systems are characterized by 
a distribution of relaxation times P{t). A broad P{t) can have an important impact 
on the dynamics leading to rare regions that take a very large time to relax. This 
leads to a strong non-exponential relaxation in contrast to non-disordered systems 
that usually display an exponential relaxatiorQ 

In the following, by focusing on the example of random ferromagnets, we shall present 
a general phenomenon taking place in disordered systems, which goes under the name 
of Griffiths phase. The Hamiltonian of a simple model of a random ferromagnet reads: 

H = — 'y ' 

{i,3) 


where the couplings are independent and identically distributed random variables with 
the distribution P(Jy) = {1— p)5{ J — Ji) -\-p5{J — J 2 ) and Ji and J 2 are both positive 
(J 2 > Ji)- This system displays a ferromagnetic phase transition at a temperature 
Tc which depends on the values of p, Ji, J 2 . It is clear that Tc has to be a increasing 
function of p. In particular Tc{p, Ji, J 2 ) is bounded between the temperatures, pP and 
at which a system with all couplings equal to Ji or J 2 orders. Numerical simula¬ 
tions of the equilibrium dynamics show that at high temperature, roughly above pP , 
correlation functions display exponential relaxation whereas below they become more 


^When they have no quantities conserved by the dynamics. 
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and more stretched. 

This result can be understood ( ]Bray and Rodgers 1988 ) (and actually proven rigor¬ 
ously (Martinelli 1998)) by noticing that there are regions inside the system that have 


all couplings equal to J 2 . Below they are ’’ordered”, or more correctly they flip 
very slowly between the two low temperature magnetised states and, hence, induce a 
very slow dynamics. The temperature regime below is called Griffiths phas^ 

Let’s be precise and recall that for an ordered ferromagnet of size L the time to flip be¬ 
tween the two low temperature magnetised states is of the order tl — exp{2Jf.f f{T)L‘^~^/T), 
where Jeff(T) plays the role of a surface tension. It equals J at zero temperature, it 
is a decreasing function of T and vanishes at Tc- The spatially averaged equilibrium 
correlation function can be easily shown to be self-averaging, hence: 


^ = K W^o^o)) 


If the origin belongs to a region of linear size L where all couplings are equal to J 2 its 
relaxation is given by . Therefore considering only cubic regions centred around 

the origin we can obtain easily the bound: 

C{t) > g-texp(-2Je,,L'‘-VT) 

L 


where the first term is the probability that in the whole cubic region of size L couplings 
are equal to J 2 and on the boundary of the cube are equal to Ji. This sum can be 
performed by the saddle-point approximation when t is large: one finds that the value 

i/(d-i) 


L{t) that dominates the sum is proportional to 


T log t 


and that: 


C{t) > Ki exp (-i^ 2 (logt)‘'/^''-^)) 

where Ki , K 2 are two positive constants that depend on p, T, Ji, J 2 • This result shows 
that even in the high-temperature regime, before the phase transition takes place, 
equilibrium correlation functions relax much slower than exponentially. This is due to 
slow and rare Grifhths regions. We focused on equilibrium dynamics but of course this 
effect is also present if one quenches the temperature in the high temperature phase 
{Tf > T,). 


5.2 Broad distribution of low energy excitations 

The Griffith phase studied in the previous section has a counterpart in quantum dis¬ 
ordered systems. Analogously to the existence of rare slow relaxing regions, quantum 
disordered systems contain rare regions that give rise to very low energy excitations. 
In particular this leads to a density of states that vanishes as a power law at low fre¬ 
quency contrary to non-disordered quantum systems that instead display a gap whose 

^The name was chosen in rela tion with the s ingularities that Griffiths found studying the thermo¬ 
dynamics of disordered systems ([Griffiths 1969^. 
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value is related to the typical energy scale. As before, let us describe this general phe¬ 


nomenon, that goes under the name of quantum Griffiths phase (Sachdev 2011), in a 


simple example which is the transverse random Ising ferromagnet whose Hamiltonian 
reads: 


h = -Y.Jk 

i'i'J) 


(7 a G, 


-rE' 


where are Pauli matrices and Jy positive and independent random variables 

with the same distribution defined in the previous section. At zero temperature this 
model displays a phase transition between an ordered ferromagnetic phase for P < Pc 
and a disordered paramagnetic phase for P > Pc, see (Sachdev 2011). 

Pc plays the same role of before: it depends on p, Ji, J 2 and is bounded between 
the values and P^^. The phase below P^^ is called quantum Griffiths phase and 
is characterized by the existence by very low energy excitations. The main arguments 
parallel the one presented in the previous sections. The system contains regions of 
linear size L inside which all couplings are equal to Ji. Their density is of the order of 
. For r < these regions are ’’ordered” hence the lowest excitation energy scales 
as ujl — exp{—KL‘^). This corresponds to a multitude of virtual processes that allow 
to go from one ordered state to the other and, hence, to lift the degeneracy between 
them. 

The density of states associated to the spin-spin correlation function is given by: 


p{uj) = E \{a\a^o\GS)\^^{co - [E^ - Egs]) 

O' 

where the index a is associated to the many body eigenstates and GS denotes the 
ground state. The contribution to the above sum due to Griffiths regions is of the 
form: exp(—[logp]L‘^)(5(cLi — exp(—AT'L'’*)). Evaluating this sum for large L one 

finds that the Griffiths regions contribution leads to a power law in the density of 
states which, when a; —>■ 0, behaves as: 


^ (loga;)('^“i/‘^) 

Thus, below pA, the density of states is not gapped and instead display non-universal 
power laws at small frequency. This in turn implies that the zero-temperature equilib¬ 
rium dynamics is very slow below P^f^. 

5.3 Activated dynamics scaling and zero temperature fixed points 

In the previous sections we studied the effects of quenched disorder on the equilibrium 
dynamics and showed that even if the system is not ordered and far from the critical 
point the dynamics can become very slow. 

Here we want instead to study the effect of the disorder on a critical point. From the 
point of view of the dynamical behaviour, one of the most remarkable effect of quenched 
disorder is to produce in some cases a critical equilibrium dynamics that is ultra-slow. 
In particular a divergence of relaxation times that is super-Arrhenius instead of being 
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power law as in standard second order phase transition. This is due to a relationship 
between time and length scales that is exponential, r ~ tq exp(^(T)'^/T), instead 
of being power law (r oc This phenomenon was called activated dynamic scaling 
(Villain 1984 Fisher 1986| ) and is due to the existence of a new kind of renormalisation 
group fixed point that we shall now describe. 

Let us first recall that for standard second order phase transition, close to the critical 
point, the system is formed by correlated regions of linear size Each region can be in 
one of the low temperature phases, e.g. positively or negatively magnetised in the case 
of ferromagnets. In a (crude) real space renormalisation group sense, each correlated 
region can be represented by a coarse grained degree of freedom, associated to the order 
parameter. The value of this degree of freedom indicates in which low temperature 
phase the correlated region is. The interaction between correlated regions is represented 
by one (or more) coupling between these degrees of freedom. For instance, in the 
ferromagnetic case one associates to each region a spin and introduce a ferromagnetic 
coupling as interaction between regions, see Fig.|5.1[ This RG picture emerges naturally 


in real space renormalisation group treatments such as the Migdal-Kadanoff one (Amit 


and Martin-Mayor 20051. 






Fig. 5.1 Sketch of the renormalised effective model on the scale ^ for the Ising model. 

The fundamental property of second order phase transition is that the coarse 
grained energy scale AFV obtained by renormalisation on the length-scale ^ is of the 
order of the temperatur^ In the previous approximate description this means that 
oc 0{T). In more formal treatment one indeed finds that the renormalised theory 
on scales larger than ^ is perturbative and high temperature like. This has several im¬ 
portant consequences. The most important one is that correlated regions are ’’active”, 
i.e. they flip rather easily, since r oc ex-p{AF^/T). Actually, it is the pre-factor to the 
Arrhenius law that matters and gives the usual power law scaling between time and 
length characteristic of critical dynamics: t oc . Another remarkable consequence is 
that the singular part of the free energy, which scales as \T — Tcp““, can be obtained 

^All these statements and the following ones are only true below the upper critical dimension 
where scaling holds. 
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as oc \T — Tc\''‘^. This directly implies the hyper-scaling relation 2 — a = vd. 

In presence of disorder this picture can break down. A new kind of fixed point can 
emerge, for which the typical energy scale on the length becomes much larger than 
the temperature. In this case is found to diverge as approaching the phase 
transition. In consequence the effective model on the scale ^ is now characterized by 
couplings much larger than the temperatur^ Since what matters is the ratio between 
couplings and temperature one can describe this situation as infinite disorder cou¬ 
plings or zero temperature fixed point. One of the main consequence is that now the 
dynamics (for instance the Monte-Carlo dynamics) of the correlated regions becomes 
extremely slow. The relaxation time is given by the Arrhenius law applied to a cor¬ 
related region: r ex exp(AFj/r). This in turn implies a super-Arrenius divergence for 
the characteristic time-scale of critical dynamics: 


^ oc 


T oc To exp 


K 


\T-T, 


|T-Te|- 

An example of this behaviour is provided by the Random Field Ising model, whose 
Hamiltonian reads: 

H = - 

{i,3) » 

where J is a ferromagnetic coupling and hi random fields corresponding to independent 
and identically distributed random variables of mean zero and variance A. A sketch 


of the phase diagram of this model is presented in Fig. 5.2 



Fig. 5.2 Sketch of the phase diagram for the Random Field Ising model. The arrow on the 
transition line indicates that the RG flow is controlled by the zero temperature fixed point. 

The transition line separates the paramagnetic and the ferromagnetic phases. Ex¬ 
cept for A = 0 the critical behaviour is governed by a zero-temperature fixed point. 

some analytical treatments where the energy scale is kept fixed under renormalisation, it is 
the temperature scale that is renormalised: Tj oc T/J®. 
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The sketchy renormalisation group picture in terms of effective model on the scale ^ 
is shown in Fig. |5.3| correlated regions are described by Ising spins interacting via 
random (ferromagnetic) couplings and coupled to random external fields. 



Fig. 5.3 Sketch of the renormalised effective model on the scale ^ for the Random Field 
Ising model. 


As found in the Migdal-Kadanoff treatment (Cao and Machta 19931, which makes 


this RG picture concrete, both the coupling and the fields scale as S> T. More 


refined treatments, such as non-perturbative functional RG (Tissier and Tarjus 2012) 


and numerical simulations (Middleton and Fisher 2002) confirm and precise these 


results (Tissier and Tarjus 2012) and lead to the numerical values for the exponent: 


6^0 ~ 1.6 and — 1-5- As explained above, this implies an extremely fast growth of 


K 

^ \T — Ta\^30‘'3D 


with 031)^30 ~ 2.4. 


the relaxation time approaching the transition (jFisher 1986 Balog and Tarjus 2015|): 
T (X tq exp 


5.4 Domain growth and coarsening in disordered systems 

Let us now consider the effect of disorder on the off-equilibrium dynamics due to 
thermal quenches. We consider, as in the previous chapter, quenches across phase 
transitions. The physics is very similar to the non-disordered case: there is a tendency 
to local equilibration, that takes place over a length-scale ^(t), but the system re¬ 
mains always out of equilibrium because of ageing dynamics (due to the slow motion 
of topological defects). What changes is the dynamics of the topological defects which 
now evolve in a disordered environment. Let us focus on the case of domain growth. 
Without quenched disorder the motion of domain is curvature-driven as we explained. 
In presence of disorder, instead, the motion of the domain boundary is governed by 
the competition between the tendency to reduce the interface energy and the gain ob¬ 


tained by wandering in profitable regions of the random environment, see (Giamarchi 


2009 Wiese and Le Doussal 2007). 


The study of domains boundary in random environment is another case in which the 
large scale physics is governed by a zero-temperature fixed point. Theory and numer¬ 


ical simulations (Giamarchi 2009 Wiese and Le Doussal 2007) have established that 


in several cases, in particular in the case of the random bond and random field ferro- 
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magnets, the domain bou ndar y is rough: on the scale I it has transverse fluctuations 
of the order of see Fig. 5.4 



Fig. 5.4 Sketch of the wandering of domain walls in random ferromagnets. 

The free-energy on the scale i is given by two contributions: 

the first one is the surface tension and is a non fluctuating quantity, in the second 
one instead T is a random variable with a universal distribution (in the RG sense). 
Plotting the energy as a function of the domain radius one finds a curve similar to 
the one in Fig. |5.5| which in average is the same than for non-disordered system but 
displays large scale barriers. A spherical domain of size £ has a tendency to shrink as 
for non-disordered systems since in this way the interface energy is decreased. However, 
in order to do so, it has to go over barriers that scale as £®. 



Fig. 5.5 Sketch of the energy as a function of the domain size: on top of the average contri¬ 
bution there is a fluctuating part of the order R® which gives rise to barriers whose 

heights increase as R®. 
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It is assumed that domain growth for disordered system can still be described 
by a scaling theory in terms of a growing length ^{t). However, now the relationship 
between time and length is no more power law, it is replaced by an activated dynamic 
relationship: 

Te cx exp ^ ^{t) cx (Tlogt)^/® 

The scaling relationship \2.2\ reads in this case: 




1 J \x-y\ logt' \ 
— y\^ \ (riogt)i/® ’ logt y 


In practice, because of the logarithms in the scaling laws domain growth in disordered 
system is a particularly slow process. It takes a very long-time to make increase the 
length ^(t) substantially. 


5.5 Infinite randomness fixed points 

The effect of quenched disorder on quantum dynamics also gives rise to new remarkable 
phenomena. This is actually a topic that is attracting a lot of attention recently and 
on which a lot of work is ongoing. Instead of giving a comprehensive presentation we 
shall briefly discuss what is one of the most influential concept and framework that 
actually mirrors what explained in the previous sections for classical dynamics. The 
starting point of it was the study of random transverse Ising chains, for example the 
one with Hamiltonian: 


where Ji > 0,hi > 0 are random quenched variables. This model displays a phase tran¬ 
sition between a disordered and a ferromagnetic ally ordered phase when A = log h 
approaches a critical value Ac from above. D. S. Fisher unveiled that the correspond¬ 
ing critical point is governed by a new kind of RG fixed point that is now called 
infinite randomness fixed point. By using the Dasgupta-Ma decimation procedure, a 
kind of real space RG where the most strongest couplings in the system are decimated 
sequentially, he showed that at criticality log Jt and log hi grow as \/i where £ is the 
length-scale over which the system is coarse-grained. This give rise to several remark¬ 
able phenomena such as strong difference between typical and average quantities and 
to an intricate critical behaviour. 

The most important point for our discussion is that the RG behaviour actually re¬ 
sembles very much the one described above for zero-temperature fixed point. Indeed, 
in his seminal papers D. S. Fisher proposed to call it ’’tunnelling dynamics scaling” 
in analogy with the ’’activated dynamics scaling” discussed previously. Although for 
a long time this RG techniques and this kind of fixed point were used to investigate 
equilibrium properties of the ground state, already in the first papers it was pointed 
out that this fixed point should have a very important influence on the dynamical 
properties and possibly give rise to very slow dynamics. Very recently, this was explic¬ 
itly shown in the context of the Many Body Localization transition (discussed by I. 
Aleiner at this school), see (Basko et al. 2006 Nandkishore and Huse 2014). This is 
certainly a research theme that will witness a lot of progress in the next few years. 
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Effective Temperatures 


The notion of effective temperatures is a recurrent theme in out of equilibrium physics. 
The notion of temperature, a single quantity that determines the state of the system, 
is so useful that researchers keep trying to find out whether it somehow holds also out 
of equilibrium. In this chapter we shall present several different notions of effective 
temperatures that have been found and discussed in the literature. 

6.1 Metastable equilibrium 

The first notion of effective temperature we wish to discuss is also the closest one to 
the equilibrium temperature we are used to. 



Fig. 6.1 Sketch of the evolution of the effective temperature of electrons in a pump and 
probe experiment. During the pump the system is truly out of equilibrium. After that, when 
is probed, electrons quickly reaches a metastable equilibrium with a well defined temperature 
that slowly evolve toward the bath temperature on much larger time-scales. 

Consider a system coupled to a thermal bath which is at temperature T. There 
are two important time-scales in the problem: one is the relaxation time, rg, of the 
degrees of freedom of the system in absence of the coupling to the bath, the other tb 
is the characteristic time over which the degrees of freedom of the bath evolve and 
exchange energy with the system. By perturbing a system, initially at equilibrium at 
temperature T, one typically injects (or withdraws) energy from the system and puts it 
out of equilibrium. Subsequently, the system starts to evolve. If rg ^ tb then on time- 
scale Ts ^ t ^ Tb the system reaches a metastable equilibrium as if it were decoupled 
from the bath. Since energy is conserved—it is not exchanged on these time-scale—the 
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system equilibrates to a temperature Ts different from the one of the bath. This is 
the micro-canonical temperature corresponding to the new value of intensive energy 
reached after the perturbation. The effective temperature Ts then slowly evolve and 
reaches T only on larger time-scales, of the order of see Fig. |6.1[ 

An example of this kind of situations was discussed by L. Perfetti at this school, see 
his lecture notes: the so-called pump and probe experiments that have been recently 
the focus on an intense experimental research in the field of out of equilibrium hard 
condensed matter. In these cases one pumps energy inside an electron system coupled 
to a phonon bath and then probe the following dynamics, for instance using a femto¬ 
second laser pulse. Since the characteristic time-scales of electrons and phonons are 
widely separated, fs and ps respectively, electrons are indeed experimentally observed 
to equilibrate at temperature Ts T. In Perfetti’s notes, it is discussed an example in 
which electrons reach a meta-stable equilibrium state characterized by a Fermi-Dirac 
distribution at a temperature Ts = 2080iF whereas the ambient temperature of the 
phonon bath is T = ISOiF.. 


6.2 Driven and Active Systems 

We focus now on systems permanently out of equilibrium. Some of them are generically 
coupled to an environment that provides dissipation and an external drive, for example 
magnetic systems through which an electronic current flow. Others constantly dissipate 
energy in order to evolve dynamically, like bacteria or other biological ’’degrees of 
freedom”. These systems generically reach a steady state which cannot be described 
by equilibrium statistical mechanics means. There are a few cases however where 
despite the fact that the system is driven or actively withdraws and then dissipates 
energy through the bath, a pseudo-equilibrium state with an effective temperature is 
reached. We shall now explain how this comes about. 

We take the general setting of quantum systems and consider the simplified case where 
all the effect of the environment and the driving can be condensed in additional self¬ 


energy terms, as we have already explained in chapter 2, see in particular eq. (2.71. In 


the absence of driving and if the environment is at equilibrium at temperature T the 
additional self-energy terms must obey the quantum fluctuation-dissipation relation 


(2.8). For systems driven out of equilibrium there is no reason for the ratio v[uj)/’^rj^uj) 
to acquire the QFDT form and, hence, no way to define an effective temperature. 
However, if the dynamics of the system takes place on time-scales much larger than 
the one typical of the drive and the environment, te-, the only thing that matters is 
the behaviour of the additional self-energy terms at low frequency. Recalling that r]{uj) 
and entering in the Schwinger-Keldysh action \2.7\ have the interpretation of 
a generalized friction and amplitude fluctuations respectively, it is not unreasonable 
that 3ry(a;) ~ tiqujte and v{u!) ~ iv{0) for uj 1/te, as it indeed happens in many 
cases. If these small frequency behaviours hold then for uj ^ I/t^: 

^ ^( 0 ) ^ ‘^Teff 

Qr]{ui) r]oujTE w 


This implies that the effect of the environment and the driving is as if the slow degrees 
of freedom of the system were only coupled to a classical thermal bath at temperature 
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As a theoretical example where this phenomenon happens we consider the model 
of two dimensional itinerant magnet placed between two noninteracting leads studied 
by A. Mitra and A. Millis (Mitra and Millis 2006). 




Fig. 6.2 Right: schematic view of itinerant magnet placed between two noninteracting leads 
(from [Mitra and Millis 2006]). Right: Schematic phase diagram. 


The schematic phase diagram for this non-equilibrium system is shown in Fig. 6.2 


it depicts a phase transition out of equilibrium between a magnetically ordered and a 
disordered state. A priori, this transition should be unrelated to the equilibrium one. 
Instead, the mechanism explained above induces a classical pseudo-equilibrium state 
for the slow critical degrees of freedom even when the quantum system is driven out 
of equilibrium by the voltage and is applied to a zero temperature bath: as far as uni¬ 


versal quantities are concerned, voltage acts as a temperature as explained in (Mitra 
and Millis 2006|) . In consequence the critical behaviour everywhere along the transition 


dome (except ior v = 0,T = 0) corresponds to classical critical slowing down despite 
the fact that the system is strongly out of equilibrium. Similarly, studying the slow 
out of equilibrium dynamics obtained changing suddenly the voltage from Vi > Vc to 


Vf < Vc, one finds that the system shows slow classical coarsening dynamics (Aron et 


al. 20091 even at zero temperature and in the regime of strong quantum fluctuations. 


The reason is again the one explained above: the slow degrees of freedom the domain 
walls in this case evolve as if the whole effect of the environment, the driving and the 
slow degrees of freedom was to provide a thermal bath at temperature Tgff. 

Another interesting example is provided by active systems, a research topic that re¬ 
ceived recently a lot of attention in connection with the properties of living matter. 
In these cases, elementary degrees of freedom move because they withdraw and then 
dissipate energy from the environment. When the typical relaxation time-scales of the 
system become much longer then the bath ones a phenomenon identical to the one 


discussed above takes place and a well-defined effective temperature emerges (Berthier 
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and Kurchan 2013). 


6.3 Glassy systems 

We end this chapter by making an exception to what stated in the introduction of 
the previous chapter and discussing briefly effective temperatures for glassy systems. 
Spin-glasses and structural glasses show an incredibly slow dynamics. After thermal 
quenches they display an ageing dynamics richer than the coarsening one discussed in 
the previous chapters. As for coarsening, the ageing dynamics is characterized by a 
separation of time-scales: short ones on which rapid degrees of freedom equilibrate and 
large ones on which the slow degrees of freedom display out of equilibrium behaviour. 
As we explained in chapter 2, one of the main signature of equilibrium dynamics is 
the fluctuation-dissipation relation (FDR) between correlation and response functions. 
The exact solution of the ageing dynamics of mean-field spin glasses (Cugliandolo and 


Kurchan 19941 suggested to look for generalisations of FDR out of equilibrium. Prag¬ 


matically one can define an effective temperature from the generalised FD relationship: 


1 


'e// 




( 6 . 1 ) 


where and are respectively the correlation and response function for a 

given observable. For an equilibrium system the previous relation is verified with Te// 
equal to the equilibrium temperature and (7, R that are just a function of t—t'. Instead, 
during ageing both functions depend on t and t' and using the previous equation to 
define 27 // one generically finds an effective temperature that depends on t,t'. 

It is remarkable that what can seem just a formal definition of temperature was shown 
in the theoretical study of spin-glasses and structural glasses to have a precise meaning 
at long times: 27 // is the effective temperature of the slow degrees of freedom, the ones 
that display ageing dynamics (Cugliandolo et al. 1997). Physically, this means that 


by probing the temperature of the system, one finds T or 27//, depending whether 
the time-scale of the thermometer are short or long. This was obtained first in the 
study of mean-field glass models and then found in numerical simulations and a few 
experiments. This notion of effective temperature was generalised also to (slowly) 
driven glassy system, e.g. sheared super-cooled liquids, where again it was found first 
analytically and then in simulations that slow degrees of freedom have an effective 
temperature different (generically higher) than the equilibrium one. In Fig. 16.3| we 

show the ’’classic” FDR plot in which the integrated response x(t, t') = dsR{s,t') 
is plotted parametrically as a function of C{t,t'). The standard equilibrium FDR 
would lead to x = — C{t,t)). By normalising the equal time correlation 

function to one, in equilibrium we would then find a straight line with slope — 1/T 
crossing the C axis at one. Instead, the result found in simulations, theory and a few 
experiments is the one shown in Fig. |6.3| for large values of C one indeed finds a 
slope —1/T, but below the value of C corresponding to the plateau value in the plots 
of C{t,t -I- t) one finds another slope equal to —IjTeff. This indeed shows that the 
formal definition described above makes sense, since Tg// depends on t, t' only through 
C. The large values of C corresponds to rapid degrees of freedom. These are the ones 
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that relax from one to the plateau value in Fig. |4.6| and they are equilibrated at the 
bath temperature T as expected. Instead the slow degrees of freedom, responsible for 
ageing, which correspond to values of C lower than the plateau value are characterized 
by an effective temperatur^ which is higher than T. 



Fig. 6.3 Single particle density fluctuations at wave-vector fc in a sheared super-cooled 
liquids (from numerical simulations [Berthier and Barrat 2002] ). Remarkably, all different 
values of k are characterized by the same value of Te//. 


The theoretical explanation of this phenomenon cannot be presented here briefly. 
Hence, we refer to specific reviews on the subject (Cugliandolo 20021. We conclude by 
mentioning that although there is a theoretical framework that suggests and explain 
effective temperature in glassy systems, and despite several simulations providing sup¬ 
porting evidences, numerical and experimental investigations are still going on in order 
to determine in a conclusive way whether this notion of effective temperature hold for 
realistic systems (Kurchan 20051. The main issue is whether Te/y really is observable 
independent, as a true temperature should be (Ninarello et al. 2014). 


^ Spin-glasses are more complicated from this point of view. They are characterized by a hierarchy 
ofTgff, one for each values of C, see ([Cugliandolo 2002|. 
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